Int4LlamaForCausalLM Class Reference

Public Member Functions
	Int4LlamaForCausalLM (std::string param_path, const struct model_config config)
struct Int4LlamaForCausalLM_output	forward (std::string param_path, const struct Int4LlamaForCausalLM_input &input)

Public Attributes
float *	logits_output = nullptr
uint8_t *	lm_head_weight

---

The documentation for this class was generated from the following files:

• llm/include/nn_modules/Int4llamaForCausalLM.h
• llm/src/nn_modules/non_cuda/Int4llamaForCausalLM.cc