transpose_1_2idx_arg Struct Reference

Public Attributes
int	start_idx
int	end_idx
Matrix3D< float >	input
Matrix3D< float >	output
Matrix3D< int8_t >	input
Matrix3D< int8_t >	output

---

The documentation for this struct was generated from the following files:

• llm/src/nn_modules/Fp32GPTBigCodeAttention.cc
• llm/src/nn_modules/Fp32OPTAttention.cc
• llm/src/nn_modules/Int4GPTBigCodeAttention.cc
• llm/src/nn_modules/Int4OPTAttention.cc
• llm/src/nn_modules/Int8OPTAttention.cc