Luca Versari 9c3f969405 Implement the Griffin model. ... Also implement support for some model variations: - Local attention. - Add support for biases. - Use RoPE only on half vectors. - Support different order of QKV weights. Co-authored-by: Andrey Mikhaylov <amik@google.com> Co-authored-by: Martin Bruse <zondolfin@gmail.com> Co-authored-by: Zoltan Szabadka <szabadka@google.com>		2024-04-08 21:45:54 +02:00
..
app.h	Implement the Griffin model.	2024-04-08 21:45:54 +02:00
args.h	Add standalone tool to compress weights.	2024-04-03 14:54:08 +00:00
convert_weights.py	Add MQA support	2024-03-20 18:17:24 +08:00