TinyChatEngine
Loading...
Searching...
No Matches
Fp32GPTBigCodeDecoderLayer Class Reference

Public Member Functions

 Fp32GPTBigCodeDecoderLayer (std::string param_path, const struct model_config config, int layer_idx)
 
struct Fp32GPTBigCodeDecoderLayer_output forward (const struct Fp32GPTBigCodeDecoderLayer_input &input)
 

Public Attributes

int embed_dim
 
int num_attention_heads
 
int hidden_dim
 
int layer_idx
 
LayerNorm ln_1
 
LayerNorm ln_2
 
Linear_FP fc1
 
Linear_FP fc2
 
Fp32GPTBigCodeAttention attn
 
std::string profile_name = "Fp32GPTBigCodeDecoderLayer"
 

The documentation for this class was generated from the following files: