Expand description
Utilities for sampling from model outputs
Functionsยง
- greedy_
sample - Greedy sampling - always return the most likely token
- sample_
top_ k - Top-k sampling - sample from the k most likely tokens
- sample_
with_ temperature - Sample a token using temperature scaling