Fp32GPTBigCodeDecoder Class Reference

Public Member Functions
	Fp32GPTBigCodeDecoder (std::string param_path, const struct model_config config)
Matrix3D< float >	prepare_decoder_attention_mask (int length, int past_length)
Matrix3D< float >	get_position_embed (int sql_length, int past_length)
struct Fp32GPTBigCodeDecoder_output	forward (const struct Fp32GPTBigCodeDecoder_input &input)

Public Attributes
Embedding	wte
Embedding	wpe
int	voc_size
int	embed_dim
int	padding_idx
int	hidden_dim
int	num_heads
int	max_position_embeddings
std::vector< Fp32GPTBigCodeDecoderLayer >	layers
LayerNorm	ln_f
std::string	profile_name = "Fp32GPTBigCodeDecoder"

---

The documentation for this class was generated from the following files:

• llm/include/nn_modules/Fp32GPTBigCodeDecoder.h
• llm/src/nn_modules/Fp32GPTBigCodeDecoder.cc