Int4LlamaForCausalLM_output Struct Reference

Public Attributes
Matrix3D< float >	logits
std::vector< Matrix3D< float > >	past_keys
std::vector< Matrix3D< float > >	past_values

---

The documentation for this struct was generated from the following file:

• llm/include/nn_modules/Int4llamaForCausalLM.h