Jan Wassenberg 8e028632f7 0.98x prefill: refactor in prep for cache blocking. ... Slower because we now init tiles of C and accumulate into them. Also remove unused var in optimize_test and use BF16 typedef. PiperOrigin-RevId: 662115916		2024-08-12 09:26:29 -07:00
..
activations.h	Prep for sharding gemma.cc: split into kv_cache, tokenizer.	2024-07-02 09:31:06 -07:00
backward-inl.h	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
backward.cc	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
backward.h	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
backward_scalar.h	Move benchmark_helper to evals/, weights_raw to compression/.	2024-07-08 01:13:23 -07:00
backward_scalar_test.cc	Refactor configurables.	2024-07-10 21:30:58 -07:00
backward_test.cc	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
common_scalar.h	Merge pull request #212 from szabadka:adam2	2024-06-07 02:25:18 -07:00
forward-inl.h	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
forward.cc	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
forward.h	1.03-1.08x decode speedup: precompute Rope theta, fuse	2024-08-09 01:23:24 -07:00
forward_scalar.h	Move benchmark_helper to evals/, weights_raw to compression/.	2024-07-08 01:13:23 -07:00
optimize_test.cc	0.98x prefill: refactor in prep for cache blocking.	2024-08-12 09:26:29 -07:00
optimizer.cc	Use Loader/AppArgs to construct gemma_test model, simplify AcceptFunc	2024-06-11 05:53:10 -07:00
optimizer.h	Support all weight types in a single binary.	2024-06-07 09:04:45 -07:00
prompt.h	Add missing include	2024-06-04 10:29:12 +00:00
sampler.h	Add config for att/final cap, skip max-subtract. Fixes #278	2024-07-01 09:45:26 -07:00
test_util.h	Move benchmark_helper to evals/, weights_raw to compression/.	2024-07-08 01:13:23 -07:00