happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,800 Commits 517 Branches 5,142 Tags 1 GiB
Commit Graph

5800 Commits

Author SHA1 Message Date
Aaron Teo 17b032fab8
ggml: refactor fp16<->fp32 simd to ggml-cpu 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 20:42:15 +08:00
Aaron Teo 8a5e011cb5
Revert "ggml: refactor fp32->fp16 and fp16->fp32 simd to ggml-cpu" 
This reverts commit bd288e8fa5.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 15:54:33 +08:00
Aaron Teo e73413bb98
Revert "ggml-cpu: fix duplicate func names during compile" 
This reverts commit fbb733451f.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 15:54:18 +08:00
Aaron Teo fbb733451f
ggml-cpu: fix duplicate func names during compile 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 15:18:20 +08:00
Aaron Teo 4d136cb6a1
docs: update broken huggingface link for s390x 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 15:11:58 +08:00
Aaron Teo bd288e8fa5
ggml: refactor fp32->fp16 and fp16->fp32 simd to ggml-cpu 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 15:05:46 +08:00
Aaron Teo 5834dee1fc
ggml-cpu: move nnpa fp16->fp32 and fp32->fp16 to simd-mappings 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-23 17:52:28 +08:00
Aaron Teo 5004e4395b
ggml-cpu: remove unnecessary target compile definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 23:37:44 +08:00
Aaron Teo 489cdf44bf
ggml-cpu: clarify naming of dlf16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 23:34:42 +08:00
Aaron Teo 07de57c69a
ggml-cpu: add todo comment for future reference 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:07:30 +08:00
Aaron Teo 72965ea8b0
ggml-cpu: add ggml-impl.h future notes 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:06:57 +08:00
Aaron Teo 46227c61c9
ggml-cpu: remove typedef from cmakelists 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:02:05 +08:00
Aaron Teo 1b4dbf477c
ggml-cpu: remove typedefs.h 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:01:21 +08:00
Aaron Teo 5c9b083511
Revert "ggml-cpu: move s390x typedef to own header file" 
This reverts commit 18d79e1a30.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:59:04 +08:00
Aaron Teo e43dc82a21
ggml-cpu: undo cmakelists work 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:56:46 +08:00
Aaron Teo 3ec0bdc1df
ggml-cpu: bring back compile definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:47:05 +08:00
Aaron Teo ebb8489a0c
ggml-cpu: add s390x detection in ggml-src 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:38:55 +08:00
Aaron Teo c8b3b89548
ggml-cpu: add compiler error macro 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:17:21 +08:00
Aaron Teo 04a395ea73
ggml-cpu: switch to quotes for import 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:11:51 +08:00
Aaron Teo 263b820b42
ggml-cpu: bring back compile macros 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:09:04 +08:00
Aaron Teo 781c263722
ggml-cpu: move things around 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:41:01 +08:00
Aaron Teo 18d79e1a30
ggml-cpu: move s390x typedef to own header file 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
(cherry picked from commit 157f856c34)
 2025-06-21 19:31:34 +08:00
Aaron Teo ba3513e44b
ggml-cpu: switch to private macros 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:27:55 +08:00
Aaron Teo a91c3ab6b0
ggml-cpu: add ggml-impl.h to cmakelists 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:19:11 +08:00
Aaron Teo 72c91436f6
ggml-cpu: move macro definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:16:40 +08:00
Aaron Teo 84593387a7
ggml-cpu: bruteforce macro definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:14:31 +08:00
Aaron Teo ed76ff6e42
ggml-cpu: add debug prints 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:11:59 +08:00
Aaron Teo fadc138763
ggml-cpu: test more macros 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:10:39 +08:00
Aaron Teo 1cacdd9a36
ggml-cpu: fix macro declaration 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:08:48 +08:00
Aaron Teo 3004a79f4b
ggml-cpu: switch to importing ggml-cpu-impl instead 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:04:09 +08:00
Aaron Teo 48df977079
Revert "ggml-cpu: move s390x typedef to own header file" 
This reverts commit 157f856c34.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:03:09 +08:00
Aaron Teo 157f856c34
ggml-cpu: move s390x typedef to own header file 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:00:20 +08:00
Aaron Teo e7910fc975
ggml-cpu: update macro tests 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:43:43 +08:00
Aaron Teo 8129838037
ggml-cpu: import vecintrin.h to fix compiler errors 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:42:02 +08:00
Aaron Teo 4ad6efa37b
ggml-cpu: diagnose why __NNPA__ macro is not being defined 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:33:08 +08:00
Aaron Teo 0e571dd3d8
ggml-cpu: add missing __func__ 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:10:26 +08:00
Aaron Teo 1547ea230c
ggml-cpu: add nnpa macro check in ggml-impl 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:09:37 +08:00
Aaron Teo f1b1d98e8d
ggml-cpu: activate nnpa fp32->fp16 or fp16->fp32 compute 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:51:55 +08:00
Aaron Teo 8ef51b9055
ggml-cpu: bring back fp32->fp16 store nnpa 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:49:36 +08:00
Aaron Teo 987d1690e4
ggml-cpu: clarified vector naming 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:39:35 +08:00
Aaron Teo 4621a23c14
ggml-cpu: add 4 element loops for fp32->fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:32:20 +08:00
Aaron Teo 373fa28e4c
ggml-cpu: change to typedef vector types 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:26:20 +08:00
Aaron Teo 7413dabc8c
ggml-cpu: fix compiler types 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:23:18 +08:00
Aaron Teo e12e9fe704
ggml-cpu: reattempt fp32->fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:20:20 +08:00
Aaron Teo 54811fc128
ggml-cpu: fix typo 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:13:57 +08:00
Aaron Teo 433d587426
ggml-cpu: reattempt fp32->fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:12:22 +08:00
Aaron Teo 946c78ebde
ggml-cpu: switch to elif macro 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:06:18 +08:00
Aaron Teo 27131e5f34
ggml-cpu: disable fp32->fp16 nnpa conversions for now 
there are some conversion failures in nnpa that requires the eyes of an
ibm stsm. will create a separate pr to introduce the fp32->fp16 change.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:58:43 +08:00
Aaron Teo 4f017d718a
ggml-cpu: test fix for conversion failure 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:55:16 +08:00
Aaron Teo 5424d9e757
ggml-cpu: add breakpoint for debugging 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:51:05 +08:00