HappyZ happyz
happyz synced commits to refs/pull/7649/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:56 -07:00
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 3 commits »
happyz synced commits to refs/pull/7675/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:56 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
b47e91ed75 common : remote --random-prompt usages
Compare 7 commits »
happyz synced commits to refs/pull/7675/head at happyz/llama.cpp from mirror 2024-06-03 18:19:56 -07:00
b47e91ed75 common : remote --random-prompt usages
4bb93223dd common : add missing header
a11eee73ed server : deduplicate parameters
Compare 3 commits »
happyz synced commits to refs/pull/7651/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:56 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7644/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:55 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
f75eedf78c extensive token check
Compare 5 commits »
happyz synced commits to refs/pull/7644/head at happyz/llama.cpp from mirror 2024-06-03 18:19:55 -07:00
f75eedf78c extensive token check
happyz synced commits to refs/pull/7647/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:55 -07:00
cb00e133cf Merge 9b156218751e7b601144b5122282045b081b2e5b into bde7cd3cd9
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7648/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:55 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7634/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:54 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7599/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:54 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7596/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:54 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7582/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:54 -07:00
3e7c6a8097 Merge 243b5efe0586c1e6fff749fbb52981e01d557bc7 into bde7cd3cd9
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
3d7ebf6312 Vulkan Mixture of Experts (MoE) support (#7628)
Compare 6 commits »
happyz synced commits to refs/pull/7642/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:54 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
8dc6f1647e Update server.cpp
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 5 commits »
happyz synced commits to refs/pull/7642/head at happyz/llama.cpp from mirror 2024-06-03 18:19:54 -07:00
8dc6f1647e Update server.cpp
happyz synced commits to refs/pull/7581/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:53 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
3d7ebf6312 Vulkan Mixture of Experts (MoE) support (#7628)
Compare 9 commits »
happyz synced commits to refs/pull/7553/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:53 -07:00
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 4 commits »
happyz synced commits to refs/pull/7531/head at happyz/llama.cpp from mirror 2024-06-03 18:19:53 -07:00
fee3c1d740 llama : allow doing the equivalent of SSM_CONV with SUM_ROWS and MUL
17f6c1ef3b llama : fix .base() compilation error on Windows
Compare 2 commits »
happyz synced commits to refs/pull/7531/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:53 -07:00
fee3c1d740 llama : allow doing the equivalent of SSM_CONV with SUM_ROWS and MUL
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
0b832d53ba make: fix debug options not being applied to NVCC (#7714)
Compare 6 commits »
happyz synced commits to refs/pull/7547/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:53 -07:00
3d7ebf6312 Vulkan Mixture of Experts (MoE) support (#7628)
Compare 2 commits »
happyz synced commits to refs/pull/7514/merge at happyz/llama.cpp from mirror 2024-06-03 18:19:52 -07:00
23fd1b587c update debug statements
07dba13ab6 temporary commit while I move dev environments
bde7cd3cd9 llama : offload to RPC in addition to other backends (#7640)
a5735e4426 ggml : use OpenMP as a thread pool (#7606)
Compare 6 commits »