mirror of https://github.com/google/gemma.cpp.git
e890d46f30
Only the weights; binding MatMul output worsens batch=1 prefill. Update gemma_batch_bench to use --decode_qbatch. Fix/remove prefill_activations in gemma-inl.h. Refactor: use BasePageBytes directly when binding Move BindB/C to .cc by de-templatizing Remove MatOwners::AllocateFor because it is weights-specific (binding or not) Disband MatOwners, replace with vector PiperOrigin-RevId: 759610477 |
||
|---|---|---|
| .. | ||
| allocator.cc | ||
| allocator.h | ||
| args.h | ||
| basics.h | ||
| mat.cc | ||
| mat.h | ||
| test_util.h | ||
| threading.cc | ||
| threading.h | ||
| threading_context.cc | ||
| threading_context.h | ||
| threading_test.cc | ||
| topology.cc | ||
| topology.h | ||