TinyChatEngine
Loading...
Searching...
No Matches
Int4llamaAttention_output Struct Reference

Public Attributes

Matrix3D< float > attn_output
 
Matrix3D< float > attn_probs_reshaped
 
std::pair< Matrix3D< float >, Matrix3D< float > > past_key_value
 

The documentation for this struct was generated from the following file: