TinyChatEngine
|
Public Attributes | |
struct matrix A B C | bias |
struct optimization_params | opt_params |
float | alpha |
float | beta |
float16_t | half_alpha |
float * | scales |
float * | offset |
float * | zero_point |
float16_t * | half_scales |
naive_float16_t * | fp16_scales |
int * | int32_zero_point |
int | block_size |
float * | A_scales |
int8_t | A_zero_point |