Copybara-Service 6763afcd1c Merge pull request #348 from ufownl:feature/start_pos_per_query_reopen ... PiperOrigin-RevId: 662533529		2024-08-13 08:51:06 -07:00
..
evals	Add MMLU eval to github	2024-05-20 10:20:53 -07:00
instantiations	Rename Gemma9B and Gemma27B to Gemma2_9B and Gemma2_27B.	2024-08-09 02:09:06 -07:00
activations.h	1.3x prefill, 0.95x decode: matmul replacing last matvec	2024-08-12 03:36:01 -07:00
common.cc	Rename Gemma9B and Gemma27B to Gemma2_9B and Gemma2_27B.	2024-08-09 02:09:06 -07:00
common.h	Rename Gemma9B and Gemma27B to Gemma2_9B and Gemma2_27B.	2024-08-09 02:09:06 -07:00
configs.h	Rename Gemma9B and Gemma27B to Gemma2_9B and Gemma2_27B.	2024-08-09 02:09:06 -07:00
gemma-inl.h	Merge pull request #348 from ufownl:feature/start_pos_per_query_reopen	2024-08-13 08:51:06 -07:00
gemma.cc	Implement `start_pos` per query for batch interface	2024-08-12 18:50:23 +02:00
gemma.h	Implement `start_pos` per query for batch interface	2024-08-12 18:50:23 +02:00
kv_cache.cc	Major revamp #2 of Prefill: fix token order, parallel for multi-query	2024-07-25 03:28:55 -07:00
kv_cache.h	Major revamp #2 of Prefill: fix token order, parallel for multi-query	2024-07-25 03:28:55 -07:00
run.cc	Add pin flag to disable pinning. Refs #338	2024-08-09 13:47:12 -07:00
tokenizer.cc	7x compile time speedup: shard gemma.cc	2024-07-03 06:35:04 -07:00
tokenizer.h	7x compile time speedup: shard gemma.cc	2024-07-03 06:35:04 -07:00
weights.cc	1.3x prefill, 0.95x decode: matmul replacing last matvec	2024-08-12 03:36:01 -07:00
weights.h	1.3x prefill, 0.95x decode: matmul replacing last matvec	2024-08-12 03:36:01 -07:00