|
TinyChatEngine
|
This is the complete list of members for Int4OPTAttention_input, including all inherited members.
| attention_mask (defined in Int4OPTAttention_input) | Int4OPTAttention_input | |
| has_past_key_value (defined in Int4OPTAttention_input) | Int4OPTAttention_input | |
| hidden_states (defined in Int4OPTAttention_input) | Int4OPTAttention_input | |
| Int4OPTAttention_input(Matrix3D< float > hidden_states_, Matrix3D< float > attention_mask_, int layer_idx_) (defined in Int4OPTAttention_input) | Int4OPTAttention_input | inline |
| Int4OPTAttention_input(Matrix3D< float > hidden_states_, Matrix3D< float > attention_mask_, Matrix3D< float > past_key_, Matrix3D< float > past_value_, bool has_past_key_value_, int layer_idx_) (defined in Int4OPTAttention_input) | Int4OPTAttention_input | inline |
| layer_idx (defined in Int4OPTAttention_input) | Int4OPTAttention_input | |
| past_key (defined in Int4OPTAttention_input) | Int4OPTAttention_input | |
| past_value (defined in Int4OPTAttention_input) | Int4OPTAttention_input |