• LogParser v0.8.2, last updated at 2026-03-30 06:59:55, http://scrapyd-0:6800/logs/sourcing_v2/bca.uk/task_51_2026-03-30T06_00_00.json

PROJECT (sourcing_v2), SPIDER (bca.uk)

  • Log analysis
  • Log categorization
  • Progress visualization
  • View log
  • Crawler.stats
  • projectsourcing_v2
    spiderbca.uk
    jobtask_51_2026-03-30T06_00_00
    first_log_time2026-03-30 06:00:14
    latest_log_time2026-03-30 06:59:46
    runtime0:59:32
    crawled_pages 134
    scraped_items 7018
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count0
    log_warning_count375
    log_redirect_count86
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A

    • WARNING+

    • warning_logs
      last 10 of 375 

      2026-03-30 06:55:23 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=122&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:55:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=123&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:56:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=123&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:56:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=123&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:56:37 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=124&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:56:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=124&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:56:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=124&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:57:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=125&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:57:07 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=125&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
      2026-03-30 06:57:07 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=125&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.

      INFO

    • redirect_logs
      last 10 of 86 

      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX16JHH/699393262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393262>
      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA19TSO/698964539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964539>
      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW18PYU/698964679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964679>
      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX16JHH/699393247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393247>
      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK19VNA/698964476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964476>
      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY68JVE/698975659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OY68JVE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
      2026-03-30 06:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW18PYU/698964649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964649>
      2026-03-30 06:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA19TSO/698964486/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964486>
      2026-03-30 06:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW18PYU/698964628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964628>
      2026-03-30 06:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RA19TSO/698964516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698964516>

      DEBUG

    • scrapy_version

      2.11.2

    • telnet_console

      127.0.0.1:6025

    • telnet_password

      72fab2389f3a9147

    • latest_crawl

      2026-03-30 06:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=125&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']

    • latest_scrape

      2026-03-30 06:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=124&sort=MostRecentlyAdded>

    • latest_stat

      2026-03-30 06:59:16 [scrapy.extensions.logstats] INFO: Crawled 134 pages (at 0 pages/min), scraped 6978 items (at 127 items/min)

    • Head

      2026-03-30 06:00:14 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 06:00:14 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 06:00:14 [bca.uk] INFO: Starting spider bca.uk
2026-03-30 06:00:14 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 06:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 06:00:15 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27cookies%27 HTTP/1.1" 200 None
2026-03-30 06:00:15 [bca.uk] INFO: No cached cookies found, will perform fresh login
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27auth_token%27 HTTP/1.1" 200 None
2026-03-30 06:00:15 [bca.uk] INFO: Loaded cached Auth0 token from Azure Tables (length=1492)
2026-03-30 06:00:15 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 06:00:15 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 06:00:15 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 06:00:15 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 06:00:15 [scrapy.extensions.telnet] INFO: Telnet Password: 72fab2389f3a9147
2026-03-30 06:00:15 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 06:00:15 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca.uk/task_51_2026-03-30T06_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 06:00:15 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:00:15 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:00:15 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 06:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 06:00:15 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:00:15 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 06:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 06:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 06:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 06:00:15 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 06:00:15 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 06:00:15 [scrapy.core.engine] INFO: Spider opened
2026-03-30 06:00:15 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 06:00:15 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025

    • Tail

      2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WG70%2520JXX') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WG71%2520JSV') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WG71%2520NUP') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ21%2520BLZ') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ56%2520NUY') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ62%2520CZR') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ66%2520FWW') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ67%2520PZB') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WK10%2520YMD') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WK15%2520VGZ') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WK21%2520YWD') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WK22%2520UHX') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WK70%2520ORG') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WL21%2520HGN') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WM18%2520FSU') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WM21%2520HNK') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WN14%2520OZK') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WN21%2520NVR') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WO19%2520XZC') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WO23%2520KVK') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WP05%2520RDX') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WP18%2520FOV') HTTP/1.1" 204 0
2026-03-30 06:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WP64%2520OFE') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WP67%2520FKX') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WP69%2520EKA') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WR57%2520DXL') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WR63%2520TXB') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WR67%2520NAE') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WS19%2520LYX') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WT17%2520DZL') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WU12%2520XBZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WU17%2520EDO') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WU20%2520HNK') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WV17%2520GKO') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WV62%2520OMB') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WV72%2520URT') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='WX22%2520WRV') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='Y99%2520HMM') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YA16%2520SYU') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YA64%2520FYB') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YA67%2520UYZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YB14%2520EOP') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YB17%2520YUD') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YB18%2520NZO') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YB19%2520MZZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YB68%2520ACF') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YB68%2520CUX') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YC07%2520XAX') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YC19%2520FGZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YC25%2520OJF') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YC68%2520XPB') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YC73%2520JSV') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YD15%2520CHY') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YD18%2520MSX') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YD19%2520KYC') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YD66%2520UEZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YD69%2520XLP') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YE09%2520ZFU') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YE12%2520ZTZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YE51%2520OEO') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YE69%2520XPG') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YE71%2520AYW') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YE71%2520EHX') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF08%2520WPU') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF11%2520DBY') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF12%2520ZJN') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF13%2520RJZ') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF18%2520YFN') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF19%2520CEA') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF19%2520HFL') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF63%2520KNL') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF72%2520AHD') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YF72%2520OUN') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YG14%2520MWD') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YG16%2520GVK') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YG17%2520PHB') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YGZ%25202902') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YH13%2520HCN') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YH18%2520FET') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YH24%2520OTN') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YH59%2520TLF') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YH66%2520YXE') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YH68%2520CLY') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YJ09%2520AZC') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YJ19%2520RDA') HTTP/1.1" 204 0
2026-03-30 06:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YJ63%2520KUA') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YK12%2520NYW') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YK17%2520WRP') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YK61%2520XYF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YK62%2520XBP') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YK71%2520EFB') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YL69%2520BXF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YL69%2520NXW') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YM67%2520LLP') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YM70%2520MVD') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YM72%2520OBF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YM73%2520GJG') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YN14%2520LPL') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YN15%2520PZF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YN22%2520PKZ') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YN71%2520VJV') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YO19%2520ZYU') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YO21%2520EMV') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YO21%2520LKC') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YO65%2520EOL') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP17%2520BYS') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP17%2520OGU') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP18%2520TEV') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP19%2520LEB') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP23%2520FKE') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP65%2520LSV') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP65%2520WSZ') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP66%2520EBM') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP68%2520PXE') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YP70%2520DTX') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YR23%2520OOF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YR61%2520OTL') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YR64%2520TYX') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YR70%2520TFY') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YR71%2520BZS') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YS16%2520DLU') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YS69%2520UXN') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YS71%2520FCM') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YT09%2520ASV') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YT13%2520YRR') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YT61%2520KVG') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YT64%2520YSC') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YU19%2520GKO') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YV23%2520XAL') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YV68%2520USX') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YW16%2520MXM') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YW71%2520JEJ') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YX19%2520RHA') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YX56%2520SDZ') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YX58%2520SUF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YX64%2520GUD') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YY12%2520ERZ') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YY15%2520YKC') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YY23%2520VAU') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='YY70%2520VWF') HTTP/1.1" 204 0
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20last_price_update_time%20lt%201774421975&NextPartitionKey=1%218%21YmNhLnVr&NextRowKey=1%2116%21WVk3MSUyMExVQg-- HTTP/1.1" 200 None
2026-03-30 06:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='bca.uk',RowKey='ZLT039913') HTTP/1.1" 204 0
2026-03-30 06:59:46 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (7018 items) in: file:///var/lib/scrapyd/items/sourcing_v2/bca.uk/task_51_2026-03-30T06_00_00.jl
2026-03-30 06:59:46 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 532315,
 'downloader/request_count': 298,
 'downloader/request_method_count/GET': 298,
 'downloader/response_bytes': 123770868,
 'downloader/response_count': 298,
 'downloader/response_status_count/200': 212,
 'downloader/response_status_count/302': 86,
 'elapsed_time_seconds': 3570.58272,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 6, 59, 46, 523074, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 7018,
 'log_count/DEBUG': 76399,
 'log_count/INFO': 82239,
 'log_count/WARNING': 375,
 'memusage/max': 223727616,
 'memusage/startup': 148156416,
 'photo_download_count': 78,
 'playwright/context_count': 2,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 2,
 'playwright/context_count/remote/False': 2,
 'playwright/page_count': 0,
 'request_depth_max': 125,
 'response_received_count': 134,
 'scheduler/dequeued': 298,
 'scheduler/dequeued/memory': 298,
 'scheduler/enqueued': 298,
 'scheduler/enqueued/memory': 298,
 'scrape_type/new': 8,
 'scrape_type/price_update': 7010,
 'scrape_type/skipped': 5377,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 126,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 15.00299794090882,
 'scrapy-zyte-api/mean_response_seconds': 16.290187211115917,
 'scrapy-zyte-api/processed': 126,
 'scrapy-zyte-api/request_args/actions': 1,
 'scrapy-zyte-api/request_args/browserHtml': 1,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 125,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 125,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 126,
 'scrapy-zyte-api/request_args/httpResponseBody': 125,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 125,
 'scrapy-zyte-api/request_args/sessionContext': 1,
 'scrapy-zyte-api/request_args/url': 126,
 'scrapy-zyte-api/status_codes/200': 126,
 'scrapy-zyte-api/success': 126,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 12395,
 'start_time': datetime.datetime(2026, 3, 30, 6, 0, 15, 940354, tzinfo=datetime.timezone.utc)}
2026-03-30 06:59:46 [scrapy.core.engine] INFO: Spider closed (finished)

    • Log

      /1/log/utf8/sourcing_v2/bca.uk/task_51_2026-03-30T06_00_00/?job_finished=True

    • Source

      http://scrapyd-0:6800/logs/sourcing_v2/bca.uk/task_51_2026-03-30T06_00_00.log

  • sourcelog
    last_update_time2026-03-30 06:59:46
    last_update_timestamp1774853986
    downloader/request_bytes532315
    downloader/request_count298
    downloader/request_method_count/GET298
    downloader/response_bytes123770868
    downloader/response_count298
    downloader/response_status_count/200212
    downloader/response_status_count/30286
    elapsed_time_seconds3570.58272
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2026, 3, 30, 6, 59, 46, 523074, tzinfo=datetime.timezone.utc)
    item_scraped_count7018
    log_count/DEBUG76399
    log_count/INFO82239
    log_count/WARNING375
    memusage/max223727616
    memusage/startup148156416
    photo_download_count78
    playwright/context_count2
    playwright/context_count/max_concurrent1
    playwright/context_count/persistent/False2
    playwright/context_count/remote/False2
    playwright/page_count0
    request_depth_max125
    response_received_count134
    scheduler/dequeued298
    scheduler/dequeued/memory298
    scheduler/enqueued298
    scheduler/enqueued/memory298
    scrape_type/new8
    scrape_type/price_update7010
    scrape_type/skipped5377
    scrapy-zyte-api/4290
    scrapy-zyte-api/attempts126
    scrapy-zyte-api/error_ratio0.0
    scrapy-zyte-api/errors0
    scrapy-zyte-api/fatal_errors0
    scrapy-zyte-api/mean_connection_seconds15.00299794090882
    scrapy-zyte-api/mean_response_seconds16.290187211115917
    scrapy-zyte-api/processed126
    scrapy-zyte-api/request_args/actions1
    scrapy-zyte-api/request_args/browserHtml1
    scrapy-zyte-api/request_args/customHttpRequestHeaders125
    scrapy-zyte-api/request_args/experimental.requestCookies125
    scrapy-zyte-api/request_args/experimental.responseCookies126
    scrapy-zyte-api/request_args/httpResponseBody125
    scrapy-zyte-api/request_args/httpResponseHeaders125
    scrapy-zyte-api/request_args/sessionContext1
    scrapy-zyte-api/request_args/url126
    scrapy-zyte-api/status_codes/200126
    scrapy-zyte-api/success126
    scrapy-zyte-api/success_ratio1.0
    scrapy-zyte-api/throttle_ratio0.0
    source/items_encountered12395
    start_timedatetime.datetime(2026, 3, 30, 6, 0, 15, 940354, tzinfo=datetime.timezone.utc)