TinyChatEngine
|
Public Member Functions | |
MetalMatmulInt4 (MTL::Device *device, MetalMatMulParams param) | |
void | prepareData () |
void | sendComputeCommand () |
void | verifyResults () |
Public Attributes | |
MTL::Device * | _mDevice |
MTL::ComputePipelineState * | _mMatmulFunctionPSO |
MTL::CommandQueue * | _mCommandQueue |
MTL::Buffer * | _mBufferA |
MTL::Buffer * | _mBufferB |
MTL::Buffer * | _mBufferScales |
MTL::Buffer * | _mBufferResult |
MTL::Buffer * | _mParams |
MetalMatMulParams * | _mParamsPtr |