Int8OPTDecoderLayer_input Struct Reference

Public Member Functions
	Int8OPTDecoderLayer_input (Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_)
	Int8OPTDecoderLayer_input (Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_, Matrix3D< int8_t > past_key_, Matrix3D< int8_t > past_value_)

Public Attributes
Matrix3D< float >	hidden_states
Matrix3D< float >	attention_mask
Matrix3D< int8_t >	past_key
Matrix3D< int8_t >	past_value
bool	has_past_key_value = false

---

The documentation for this struct was generated from the following file:

• llm/include/nn_modules/Int8OPTDecoderLayer.h