TinyChatEngine
Loading...
Searching...
No Matches
Fp32OPTDecoderLayer_output Struct Reference

Public Member Functions

 Fp32OPTDecoderLayer_output (Matrix3D< float > hidden_states_, Matrix3D< float > attentions_, std::pair< Matrix3D< float >, Matrix3D< float > > past_key_value_)
 

Public Attributes

Matrix3D< float > hidden_states
 
Matrix3D< float > attentions
 
std::pair< Matrix3D< float >, Matrix3D< float > > past_key_value
 

The documentation for this struct was generated from the following file: