During generation, the logprobs API returns the top candidate options for every token position, and Treewalker extracts the alternative tokens above that threshold to spawn new completion paths.
Referenced by
