Commit Graph

12 Commits

Author SHA1 Message Date
ochafik 80c793047b openai: fix message merging for mixtral (parallel calls) 2024-04-27 23:14:11 +01:00
ochafik ea34bd3e5c agent/openai:nits 2024-04-27 23:14:11 +01:00
ochafik ce2fb0155f agent: add --allow_parallel_calls 2024-04-27 23:14:11 +01:00
ochafik e874565a13 agent: split code from openai example 2024-04-27 23:14:11 +01:00
ochafik 253b68d9a7 server.py: crude reactor 2024-04-27 23:14:11 +01:00
ochafik 59b411406f server.py: refactor chat handlers 2024-04-27 23:14:11 +01:00
ochafik 5f3de16116 server.py: pass all request options, comments in ts sigs, render tool calls 2024-04-27 23:14:11 +01:00
ochafik 63a384deaf server.py: raise n_predict 2024-04-27 23:14:11 +01:00
ochafik a4062935a5 server.py: reenable grammar, accommodate mistral's escaped underscores 2024-04-27 23:14:11 +01:00
ochafik aa9605c751 server.py: kinda api-compliant output, disabled grammar 2024-04-27 23:14:11 +01:00
ochafik 8afd4de17b server.py: make tools work w/ mixtral-8x7b-instruct 2024-04-27 23:14:11 +01:00
ochafik d5d9993679 server.py: default tools work! 2024-04-27 23:14:11 +01:00