Four Over Six

See Quantization for details on quantizing tensors to FP4, and Matrix Multiplication for performing matrix multiplication with FP4 tensors.