9 Commits

Author	SHA1	Message	Date
RangerUFO	6923aec853	Add MQA support	2024-03-20 18:17:24 +08:00
RangerUFO	130e1f678f	Adjust vocab size to be the same as gemma_pytorch	2024-03-20 18:17:24 +08:00
pculliton	f520e5c25c	Remove WIP messages.	2024-03-13 11:36:19 -04:00
Phil Culliton	b6831a2256	Fixed 7B conversion.	2024-03-12 21:12:28 +00:00
Phil Culliton	2161908f50	Added 7B support and args parsing. Still todo: more testing of 7B conversion.	2024-03-07 22:34:14 +00:00
Phil Culliton	c93e1a1e4d	Resolved layer ordering, reshaping, MQA->MHA, and quantization. Works only for 2B.	2024-03-05 17:54:55 +00:00
austinvhuang	3c69695c1e	transformations and validations (wip)	2024-03-02 14:46:51 -05:00
austinvhuang	7d7d43e661	converter transformations (wip)	2024-03-02 08:11:55 -05:00
austinvhuang	5be9a2243f	initial (wip) convert_weights script from pytorch	2024-03-01 15:52:51 -05:00