llama.cpp

History

Daniel Bevenius 61693b5bda update save-state.cpp to use llama_state_load_file This commit updates the save-load-state example to utilize the new llama_state_load_file function for loading the model state from a file. And it also replays the last token after loading since this state is now stored before the last token is processed. I'm not sure if this is acceptable or not, as it does change the example to not directly use llama_state_get_data and llama_state_set_data for loading which might have been the point of the example.	2026-02-06 12:47:02 +01:00
..
CMakeLists.txt	ggml : move AMX to the CPU backend (#10570 )	2024-11-29 21:54:58 +01:00
save-load-state.cpp	update save-state.cpp to use llama_state_load_file	2026-02-06 12:47:02 +01:00

update save-state.cpp to use llama_state_load_file

This commit updates the save-load-state example to utilize the new
llama_state_load_file function for loading the model state from a file.
And it also replays the last token after loading since this state is now
stored before the last token is processed.

I'm not sure if this is acceptable or not, as it does change the example
to not directly use llama_state_get_data and llama_state_set_data for
loading which might have been the point of the example.

2026-02-06 12:47:02 +01:00

CMakeLists.txt

ggml : move AMX to the CPU backend (#10570 )

2024-11-29 21:54:58 +01:00

save-load-state.cpp

update save-state.cpp to use llama_state_load_file

2026-02-06 12:47:02 +01:00