gemma.cpp

590 Commits 20 Branches 5 Tags 35 MiB

Author	SHA1	Message	Date
Jan Wassenberg	1b72c22345	Refactor Gemma ctor and improve pool NUMA support Gemma receives a MatMulEnv arg, with comment on lifetime Split threading into topology so the latter can be used in allocator Add AllocClasses() for non-POD (ThreadPool) Support binding pool to NUMA node Update threading_test with latency measurements Also update Highway version. PiperOrigin-RevId: 736904748	2025-03-14 10:19:00 -07:00
Jan Wassenberg	6ab3ff5bde	Minor cleanup, Windows+Bazel build fixes add app.h comment compress-inl: remove unused typedef gemma-inl: add missing HWY_ATTR and cast separate sum-inl.h and basics.h headers replace more hwy::bfloat16_t with BF16 update include pragmas update dot_test thresholds update Highway version in Bazel for HWY_RCAST_ALIGNED fix PiperOrigin-RevId: 684464326	2024-10-10 09:05:06 -07:00
RangerUFO	42ab476a9a	Fix the file name conflicts on case-insensitive systems	2024-09-19 13:54:35 +08:00

Author

SHA1

Message

Date

Jan Wassenberg

1b72c22345

Refactor Gemma ctor and improve pool NUMA support

Gemma receives a MatMulEnv arg, with comment on lifetime
Split threading into topology so the latter can be used in allocator
Add AllocClasses() for non-POD (ThreadPool)
Support binding pool to NUMA node
Update threading_test with latency measurements
Also update Highway version.

PiperOrigin-RevId: 736904748

2025-03-14 10:19:00 -07:00

Jan Wassenberg

6ab3ff5bde

Minor cleanup, Windows+Bazel build fixes

add app.h comment
compress-inl: remove unused typedef
gemma-inl: add missing HWY_ATTR and cast
separate sum-inl.h and basics.h headers
replace more hwy::bfloat16_t with BF16
update include pragmas
update dot_test thresholds
update Highway version in Bazel for HWY_RCAST_ALIGNED fix
PiperOrigin-RevId: 684464326

2024-10-10 09:05:06 -07:00

RangerUFO

42ab476a9a

Fix the file name conflicts on case-insensitive systems

2024-09-19 13:54:35 +08:00

Renamed from examples/hello_world/BUILD (Browse further)

3 Commits