10 Commits

Author	SHA1	Message	Date
Jan Wassenberg	3e2396f98c	Use Loader/AppArgs to construct gemma_test model, simplify AcceptFunc ... accept_token: allow default, check if empty when using allow mixing sample_func and stream_func, call the latter after the former Also fix missing includes/deps. PiperOrigin-RevId: 642240012	2024-06-11 05:53:10 -07:00
Copybara-Service	49d814b519	Merge pull request #224 from szabadka:cleanup ... PiperOrigin-RevId: 641922102	2024-06-10 09:11:13 -07:00
Zoltan Szabadka	6ca4a8e345	Address review comments	2024-06-10 15:27:22 +00:00
Zoltan Szabadka	a3a75b77f9	Use CompressedWeights<TConfig<float>> in backpropagation. ... kWeightsAreCompressed are removed and LoadRawWeights is moved to compress_weights.cc	2024-06-10 14:34:24 +00:00
Jan Wassenberg	36e6915e18	Add CPU output, error if not C++17, simplify tokenizer ctor ... PiperOrigin-RevId: 641850879	2024-06-10 04:01:11 -07:00
Jan Wassenberg	f9b390b134	Support all weight types in a single binary. ... This changes the command line flags, but the default value retains the previous behavior. Also add a CreateGemma helper to enable extra args without interface changes. PiperOrigin-RevId: 641266411	2024-06-07 09:04:45 -07:00
Copybara-Service	f7ac7092d6	Merge pull request #212 from szabadka:adam2 ... PiperOrigin-RevId: 641182573	2024-06-07 02:25:18 -07:00
Zoltan Szabadka	c004799cdc	Add Adam optimizer. ... Drive-by: Fix compilation errors and tests for backprop functions.	2024-06-06 18:41:36 +00:00
Jan Wassenberg	57c2cd8b52	Simplifications: remove GemmaInterface and GemmaImpl ... Split common and weights into separate lib Remove common-inl (does not have to be SIMD code), activations.cc Centralize switch(Model) to avoid duplication Move CompressWeightsT to compress_weights.cc Move LoadWeights to weights.cc PiperOrigin-RevId: 640869202	2024-06-06 05:54:21 -07:00
Zoltan Szabadka	df01700b54	Move the backpropagation code to its own directory	2024-06-04 10:20:16 +00:00

Renamed from gemma/optimizer.cc (Browse further)