Int4GPTBigCodeAttention_output Struct Reference

Public Attributes
Matrix3D< float >	attn_output
Matrix3D< float >	attn_probs_reshaped
std::pair< Matrix3D< float >, Matrix3D< float > >	past_key_value

---

The documentation for this struct was generated from the following file:

• llm/include/nn_modules/Int4GPTBigCodeAttention.h