Int4GPTBigCodeDecoderLayer Class Reference

Public Member Functions
	Int4GPTBigCodeDecoderLayer (std::string param_path, const struct model_config config, int layer_idx)
struct Int4GPTBigCodeDecoderLayer_output	forward (const struct Int4GPTBigCodeDecoderLayer_input &input)

Public Attributes
int	embed_dim
int	num_attention_heads
int	hidden_dim
int	layer_idx
LayerNorm	ln_1
LayerNorm	ln_2
Linear_FP_int4	fc1
Linear_FP_int4	fc2
Int4GPTBigCodeAttention	attn
std::string	profile_name = "Int4GPTBigCodeDecoderLayer"

---

The documentation for this class was generated from the following files:

• llm/include/nn_modules/Int4GPTBigCodeDecoderLayer.h
• llm/src/nn_modules/Int4GPTBigCodeDecoderLayer.cc