From 8dc0e5ea835f015ea84ca42c21926b045a29585b Mon Sep 17 00:00:00 2001 From: Jan Wassenberg Date: Fri, 7 Jun 2024 00:53:58 -0700 Subject: [PATCH] Fix reference to GEMMA_WEIGHT_T. Refs #198 PiperOrigin-RevId: 641161403 --- README.md | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 30f2b4d..4626e3f 100644 --- a/README.md +++ b/README.md @@ -149,14 +149,15 @@ For the 8-bit switched floating point weights (sfp), run cmake with no options: cmake -B build ``` -**or** if you downloaded bfloat16 weights (any model *without* `-sfp` in the name), -instead of running cmake with no options as above, run cmake with WEIGHT_TYPE -set to [highway's](https://github.com/google/highway) `hwy::bfloat16_t` type -(this will be simplified in the future, we recommend using `-sfp` weights -instead of bfloat16 for faster inference): +**or** if you downloaded bfloat16 weights (any model *without* `-sfp` in the +name), instead of running cmake with no options as above, run cmake with +GEMMA_WEIGHT_T set to [highway's](https://github.com/google/highway) +`hwy::bfloat16_t` type. We intend to soon support all weight types without +requiring compiler flags. Note that we recommend using `-sfp` weights instead of +bfloat16 for faster inference. ```sh -cmake -B build -DWEIGHT_TYPE=hwy::bfloat16_t +cmake -B build -DGEMMA_WEIGHT_T=hwy::bfloat16_t ``` After running whichever of the above `cmake` invocations that is appropriate for