TinyChatEngine
Loading...
Searching...
No Matches
Int8OPTDecoderLayer_input Struct Reference

Public Member Functions

 Int8OPTDecoderLayer_input (Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_)
 
 Int8OPTDecoderLayer_input (Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_, Matrix3D< int8_t > past_key_, Matrix3D< int8_t > past_value_)
 

Public Attributes

Matrix3D< float > hidden_states
 
Matrix3D< float > attention_mask
 
Matrix3D< int8_t > past_key
 
Matrix3D< int8_t > past_value
 
bool has_past_key_value = false
 

The documentation for this struct was generated from the following file: