TinyChatEngine
|
Public Member Functions | |
Fp32llamaDecoderLayer_output (Matrix3D< float > hidden_states_, Matrix3D< float > attentions_, std::pair< Matrix3D< float >, Matrix3D< float > > past_key_value_) | |
Public Attributes | |
Matrix3D< float > | hidden_states |
Matrix3D< float > | attentions |
std::pair< Matrix3D< float >, Matrix3D< float > > | past_key_value |