Closed
Description
The user can optionally pass a suppressed_tokens
arg to GPT-2/BART's generate()
function. We will set the probability of these tokens to 0 (i.e., logits to -infinity), so that they aren't generated. This is super-useful in order to avoid generating a special token (like bos token) during generation.