TinyChatEngine
Loading...
Searching...
No Matches
Int4llamaDecoderLayer_input Member List

This is the complete list of members for Int4llamaDecoderLayer_input, including all inherited members.

attention_mask (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_input
has_past_key_value (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_input
hidden_states (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_input
Int4llamaDecoderLayer_input(Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_) (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_inputinline
Int4llamaDecoderLayer_input(Matrix3D< float > &hidden_states_, Matrix3D< float > &attention_mask_, Matrix3D< float > past_key_, Matrix3D< float > past_value_) (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_inputinline
past_key (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_input
past_value (defined in Int4llamaDecoderLayer_input)Int4llamaDecoderLayer_input