pub const SWIGLU_OAI_ALPHA: f32 = 1.702;
gpt-oss’s SwiGLU sigmoid steepness (llama-graph.cpp, LLM_FFN_SWIGLU_OAI_MOE: constexpr float alpha = 1.702f).
llama-graph.cpp
LLM_FFN_SWIGLU_OAI_MOE
constexpr float alpha = 1.702f