PAD_TOKEN

gpt_model::tokenizer

Constant PAD_TOKEN 

Source 
pub const PAD_TOKEN: i32 = 50256;
Expand description

Token 50256 is used as the padding token, which corresponds to the <|endoftext|> token in the OpenAI GPT-2 encoder.