Int4llamaDecoderLayer_input Struct Reference

Public Member Functions
	Int4llamaDecoderLayer_input (Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_)
	Int4llamaDecoderLayer_input (Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_, Matrix3D< float > past_key_, Matrix3D< float > past_value_)

Public Attributes
bool	has_past_key_value = false
Matrix3D< float >	hidden_states
Matrix3D< float >	attention_mask
Matrix3D< float >	past_key
Matrix3D< float >	past_value

---

The documentation for this struct was generated from the following file:

• llm/include/nn_modules/Int4llamaDecoderLayer.h