pub struct Gpt2Config {
Show 17 fields pub attn_pdrop: Option<f64>, pub embd_pdrop: Option<f64>, pub hidden_dropout_prob: Option<f64>, pub afn: Option<Activation>, pub initializer_range: f64, pub layer_norm_epsilon: f64, pub n_ctx: i64, pub n_embd: i64, pub n_head: i64, pub n_layer: i64, pub n_positions: i64, pub num_labels: Option<i64>, pub output_past: Option<bool>, pub output_attentions: Option<bool>, pub output_hidden_states: Option<bool>, pub resid_pdrop: Option<f64>, pub vocab_size: i64,
}
Expand description

GPT2 model configuration

Defines the GPT2 model architecture (e.g. number of layers, hidden layer size, vocab size…). Shared between GPT and GPT2 models

Fields

attn_pdrop: Option<f64>embd_pdrop: Option<f64>hidden_dropout_prob: Option<f64>afn: Option<Activation>initializer_range: f64layer_norm_epsilon: f64n_ctx: i64n_embd: i64n_head: i64n_layer: i64n_positions: i64num_labels: Option<i64>output_past: Option<bool>output_attentions: Option<bool>output_hidden_states: Option<bool>resid_pdrop: Option<f64>vocab_size: i64

Trait Implementations

Returns a copy of the value. Read more

Performs copy-assignment from source. Read more

Loads a Config object from a JSON file. The format is expected to be aligned with the Transformers library configuration files for each model. The parsing will fail if non-optional keys expected by the model are missing. Read more

Formats the value using the given formatter. Read more

Returns the “default value” for a type. Read more

Deserialize this value from the given Serde deserializer. Read more

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations

Blanket Implementations

Gets the TypeId of self. Read more

Immutably borrows from an owned value. Read more

Mutably borrows from an owned value. Read more

Returns the argument unchanged.

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

The alignment of pointer.

The type for initializers.

Initializes a with the given initializer. Read more

Dereferences the given pointer. Read more

Mutably dereferences the given pointer. Read more

Drops the object pointed to by the given pointer. Read more

Should always be Self

The resulting type after obtaining ownership.

Creates owned data from borrowed data, usually by cloning. Read more

🔬 This is a nightly-only experimental API. (toowned_clone_into)

Uses borrowed data to replace owned data, usually by cloning. Read more

The type returned in the event of a conversion error.

Performs the conversion.

The type returned in the event of a conversion error.

Performs the conversion.

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more