TinyChatEngine
|
Public Member Functions | |
Fp32GPTBigCodeDecoderLayer (std::string param_path, const struct model_config config, int layer_idx) | |
struct Fp32GPTBigCodeDecoderLayer_output | forward (const struct Fp32GPTBigCodeDecoderLayer_input &input) |
Public Attributes | |
int | embed_dim |
int | num_attention_heads |
int | hidden_dim |
int | layer_idx |
LayerNorm | ln_1 |
LayerNorm | ln_2 |
Linear_FP | fc1 |
Linear_FP | fc2 |
Fp32GPTBigCodeAttention | attn |
std::string | profile_name = "Fp32GPTBigCodeDecoderLayer" |