Int4LlamaForCausalLM_input Struct Reference

Public Member Functions
	Int4LlamaForCausalLM_input (Matrix3D< int > input_ids_)
	Int4LlamaForCausalLM_input (Matrix3D< int > input_ids_, std::vector< Matrix3D< float > > past_keys_, std::vector< Matrix3D< float > > past_values_)
	Int4LlamaForCausalLM_input (Matrix3D< int > input_ids_, Matrix3D< float > image_embed_, Matrix3D< int > second_input_ids_)
	Int4LlamaForCausalLM_input (Matrix3D< int > input_ids_, Matrix3D< float > image_embed_)

Public Attributes
Matrix3D< int >	input_ids
Matrix3D< float >	image_embed
Matrix3D< int >	second_input_ids
bool	has_past_keys_values
bool	is_llava
std::vector< Matrix3D< float > >	past_keys
std::vector< Matrix3D< float > >	past_values

---

The documentation for this struct was generated from the following file:

• llm/include/nn_modules/Int4llamaForCausalLM.h