|
TinyChatEngine
|
Public Attributes | |
| struct matrix A B C | bias |
| struct optimization_params | opt_params |
| float | alpha |
| float | beta |
| float16_t | half_alpha |
| float * | scales |
| float * | offset |
| float * | zero_point |
| float16_t * | half_scales |
| naive_float16_t * | fp16_scales |
| int * | int32_zero_point |
| int | block_size |
| float * | A_scales |
| int8_t | A_zero_point |