Sign in

The branching probability threshold is a configurable percentage confidence floor that determines how likely a candidate token must be to trigger an exploratory completion query, controlling the depth and breadth of alternative paths explored.

flowchart TD
    A["Prefix: 'Custom'"] --> B["Top Token: 'sports' (75%)"]
    A --> C["Alt Token: 'cycling' (18%)"]
    A --> D["Alt Token: 'team' (5%)"]
    
    subgraph Evaluation["Threshold Evaluation (Floor = 10%)"]
        C -->|"≥ 10%"| E["Spawn Branch Query"]
        D -->|"< 10%"| F["Prune Token"]
    end
    
    E --> G["Completed: 'Custom cycling jerseys'"]
  1. 1 How alternative completions are formatted (recommended)
  2. 2 Default threshold settings in Treewalker
  3. 3 Comparing ungrounded branches to search grounding
Proactive Suggestion: Setting the threshold below 10% substantially increases branch API calls without reliably yielding distinct semantic associations.

Referenced by