Int8OPTDecoderLayer_output Struct Reference

Public Member Functions
	Int8OPTDecoderLayer_output (Matrix3D< float > hidden_states_, Matrix3D< int8_t > attentions_, std::pair< Matrix3D< int8_t >, Matrix3D< int8_t > > past_key_value_)

Public Attributes
Matrix3D< float >	hidden_states
Matrix3D< int8_t >	attentions
std::pair< Matrix3D< int8_t >, Matrix3D< int8_t > >	past_key_value

---

The documentation for this struct was generated from the following file:

• llm/include/nn_modules/Int8OPTDecoderLayer.h