Jan Wassenberg 9efdcfd45c 1.07x batch decode speedup: more BF16 weights and activations ... BF16 att_sums and ffw_out Support BF16 B views without decompression Support arbitrary types in MulByConstAndAdd, AddFrom Also update profiler annotations in ops-inl.h PiperOrigin-RevId: 766995010		2025-06-03 23:30:18 -07:00
..
benchmark.cc	Replace RowVectorBatch with MatStorageT	2025-05-12 09:16:12 -07:00
benchmark_helper.cc	1.07x batch decode speedup: more BF16 weights and activations	2025-06-03 23:30:18 -07:00
benchmark_helper.h	Rename-only: remove Allocator2 etc suffixes now that refactoring is complete	2025-05-06 09:12:43 -07:00
benchmarks.cc	Introduce QueryResult in GemmaEnv and add a shortcut for WrapAndTokenize.	2024-10-14 04:45:21 -07:00
cross_entropy.cc	Huge refactor of weight handling and model loading.	2025-05-06 04:44:21 -07:00
cross_entropy.h	Huge refactor of weight handling and model loading.	2025-05-06 04:44:21 -07:00
debug_prompt.cc	Move fields, io* and blob* from compression/ into io/	2025-05-06 11:17:19 -07:00
gemma_batch_bench.cc	1.07x batch decode speedup: more BF16 weights and activations	2025-06-03 23:30:18 -07:00
gemma_test.cc	Shorten gemma_test so we can run it for more models.	2025-05-16 11:14:41 -07:00
prompts.h	Benchmark gemma.cpp with different length inputs.	2024-10-10 15:59:26 -07:00
run_mmlu.cc	Move fields, io* and blob* from compression/ into io/	2025-05-06 11:17:19 -07:00