mirror of https://github.com/google/gemma.cpp.git
301dc8067a
Supports converting all weight/activation formats to native MulT (bf16/f32) Also: - ConstMat/MutableMat for const correctness - Move RowVectorBatch to allocator.h so it can be used from Matmul - Add matmul.h so MatMulEnv can be used from Activations - Remove kMaxThreads, detect from PerClusterPools - Build fix: -inl.h files must be textual_hdrs, and highway.h should precede -inl.h ``` zen4 new 64, 24576, 3072, add=0, MatTA=bf16, MatTB=sfp: 616.6 GFLOPS. 64, 3072, 24576, add=0, MatTA=bf16, MatTB=sfp: 460.7 GFLOPS. 64, 24576, 3072, add=0, MatTA=f32, MatTB=sfp: 598.6 GFLOPS. 64, 3072, 24576, add=0, MatTA=f32, MatTB=sfp: 435.6 GFLOPS. zen4 old 64, 24576, 3072, add=0, MatTA=f32, MatTB=sfp: 257.5 GFLOPS. 64, 3072, 24576, add=0, MatTA=f32, MatTB=sfp: 231.9 GFLOPS. ``` PiperOrigin-RevId: 663729812 |
||
|---|---|---|
| .. | ||
| activations.h | ||
| backward-inl.h | ||
| backward.cc | ||
| backward.h | ||
| backward_scalar.h | ||
| backward_scalar_test.cc | ||
| backward_test.cc | ||
| common_scalar.h | ||
| forward-inl.h | ||
| forward.cc | ||
| forward.h | ||
| forward_scalar.h | ||
| optimize_test.cc | ||
| optimizer.cc | ||
| optimizer.h | ||
| prompt.h | ||
| sampler.h | ||
| test_util.h | ||