TinyChatEngine
Loading...
Searching...
No Matches
Fp32OPTDecoderLayer Class Reference

Public Member Functions

 Fp32OPTDecoderLayer (std::string param_path, const struct model_config config, int layer_idx)
 
struct Fp32OPTDecoderLayer_output forward (const struct Fp32OPTDecoderLayer_input &input)
 

Public Attributes

int embed_dim
 
int num_attention_heads
 
int hidden_dim
 
int layer_idx
 
LayerNorm self_attn_layer_norm
 
LayerNorm final_layer_norm
 
Linear_FP fc1
 
Linear_FP fc2
 
Fp32OPTAttention attn
 
std::string profile_name = "Fp32OPTDecoderLayer"
 

The documentation for this class was generated from the following files: