|
TinyChatEngine
|
Public Member Functions | |
| MetalMatmulInt4 (MTL::Device *device, MetalMatMulParams param) | |
| void | prepareData () |
| void | sendComputeCommand () |
| void | verifyResults () |
Public Attributes | |
| MTL::Device * | _mDevice |
| MTL::ComputePipelineState * | _mMatmulFunctionPSO |
| MTL::CommandQueue * | _mCommandQueue |
| MTL::Buffer * | _mBufferA |
| MTL::Buffer * | _mBufferB |
| MTL::Buffer * | _mBufferScales |
| MTL::Buffer * | _mBufferResult |
| MTL::Buffer * | _mParams |
| MetalMatMulParams * | _mParamsPtr |