Commit Graph

9 Commits

Author SHA1 Message Date
ochafik 253b68d9a7 server.py: crude reactor 2024-04-27 23:14:11 +01:00
ochafik 59b411406f server.py: refactor chat handlers 2024-04-27 23:14:11 +01:00
ochafik 5f3de16116 server.py: pass all request options, comments in ts sigs, render tool calls 2024-04-27 23:14:11 +01:00
ochafik 63a384deaf server.py: raise n_predict 2024-04-27 23:14:11 +01:00
ochafik a4062935a5 server.py: reenable grammar, accommodate mistral's escaped underscores 2024-04-27 23:14:11 +01:00
ochafik aa9605c751 server.py: kinda api-compliant output, disabled grammar 2024-04-27 23:14:11 +01:00
ochafik 8afd4de17b server.py: make tools work w/ mixtral-8x7b-instruct 2024-04-27 23:14:11 +01:00
ochafik d5d9993679 server.py: default tools work! 2024-04-27 23:14:11 +01:00
ochafik 63d13245e1 server.py: hacky code 2024-04-27 23:14:11 +01:00