TinyChatEngine
Loading...
Searching...
No Matches
Int8OPTAttention_input Struct Reference

Public Member Functions

 Int8OPTAttention_input (Matrix3D< int8_t > hidden_states_, Matrix3D< float > attention_mask_, int layer_idx_)
 
 Int8OPTAttention_input (Matrix3D< int8_t > hidden_states_, Matrix3D< float > attention_mask_, Matrix3D< int8_t > past_key_, Matrix3D< int8_t > past_value_, bool has_past_key_value_, int layer_idx_)
 

Public Attributes

Matrix3D< int8_t > hidden_states
 
Matrix3D< float > attention_mask
 
Matrix3D< int8_t > past_key
 
Matrix3D< int8_t > past_value
 
bool has_past_key_value = false
 
int layer_idx
 

The documentation for this struct was generated from the following file: