|
TinyChatEngine
|
Public Member Functions | |
| Fp32GPTBigCodeDecoderLayer (std::string param_path, const struct model_config config, int layer_idx) | |
| struct Fp32GPTBigCodeDecoderLayer_output | forward (const struct Fp32GPTBigCodeDecoderLayer_input &input) |
Public Attributes | |
| int | embed_dim |
| int | num_attention_heads |
| int | hidden_dim |
| int | layer_idx |
| LayerNorm | ln_1 |
| LayerNorm | ln_2 |
| Linear_FP | fc1 |
| Linear_FP | fc2 |
| Fp32GPTBigCodeAttention | attn |
| std::string | profile_name = "Fp32GPTBigCodeDecoderLayer" |