happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gemma.cpp/gemma
History
Zoltan Szabadka 36e4d8bbfe Add first version of backpropagation support. 
This is still in progress / experimental, currently it is only
implemented for normal gemma MQA attention layers, and no
parallelism is added yet for backward pass.

Since we need to remember all activations from all layers, the
forward pass was also reimplemented with a new activation data
structure.
 		2024-06-04 08:37:49 +00:00
..
evals Add MMLU eval to github 2024-05-20 10:20:53 -07:00
activations.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
activations.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
backward-inl.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
backward.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
backward.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
backward_scalar.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
backward_scalar_test.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
backward_test.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
benchmark.cc Add MMLU eval to github 2024-05-20 10:20:53 -07:00
common-inl.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
common.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
common_scalar.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
common_scalar.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
compress_weights.cc Improve documentation for compress_weights flags 2024-04-29 06:49:50 -07:00
configs.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
forward-inl.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
forward.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
forward.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
forward_scalar.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
gemma.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
gemma.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
gemma_test.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
ops.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
ops_test.cc Unrolled / tiled 4x4 MatMul 2024-05-29 13:02:35 -07:00
optimize_test.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
optimizer.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
optimizer.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
prompt.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
run.cc Update to Highway 1.2 for topology/VQSelect 2024-05-31 12:29:10 -07:00
run_mmlu.cc Add MMLU eval to github 2024-05-20 10:20:53 -07:00
sampler.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
test_util.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
weights.cc Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00
weights.h Add first version of backpropagation support. 2024-06-04 08:37:49 +00:00