Commit Graph

27 Commits

Author SHA1 Message Date
Olivier Chafik 89dcc062a4 agent: mypy type fixes
mypy examples/agent/__main__.py
mypy examples/agent/fastify.py
mypy examples/openai/__main__.py
2024-04-27 23:15:45 +01:00
Olivier Chafik 6880f1d4c0 agent: support basic openapi tools (incl. from fastify sandbox) 2024-04-27 23:14:11 +01:00
ochafik b447a743fb agent: revert to json schemas (ts not ready for refs) 2024-04-27 23:14:11 +01:00
ochafik 701a66d80f agent: fix response_format 2024-04-27 23:14:11 +01:00
ochafik 22fe86d8b8 openai tools: TS signatures work well too at a fraction of the eval cost 2024-04-27 23:14:11 +01:00
ochafik 19811a4011 openai: tests didn't catch output format 2024-04-27 23:14:11 +01:00
ochafik da2067a0d6 openai: only special-format assistant in thoughtful mode 2024-04-27 23:14:11 +01:00
ochafik 6935503b53 openai: refactor chat handler vs. template 2024-04-27 23:14:11 +01:00
ochafik 3c3eff52aa openai: quiet + update prompt output 2024-04-27 23:14:11 +01:00
ochafik d8a53eadf2 openai: test features of templates at runtime, to make sure no bits of intel are lost 2024-04-27 23:14:11 +01:00
ochafik 61f35e07a5 agent: prepare to test various templates 2024-04-27 23:14:11 +01:00
ochafik 3da30ed89e agent: fix functionary tool_calls templating 2024-04-27 23:14:11 +01:00
ochafik eb9a5524eb agent: nits 2024-04-27 23:14:11 +01:00
ochafik e0c8af4ba0 agent: --style 2024-04-27 23:14:11 +01:00
ochafik 9ab493f67e Update prompting.py 2024-04-27 23:14:11 +01:00
ochafik 80c793047b openai: fix message merging for mixtral (parallel calls) 2024-04-27 23:14:11 +01:00
ochafik ea34bd3e5c agent/openai:nits 2024-04-27 23:14:11 +01:00
ochafik ce2fb0155f agent: add --allow_parallel_calls 2024-04-27 23:14:11 +01:00
ochafik e874565a13 agent: split code from openai example 2024-04-27 23:14:11 +01:00
ochafik 253b68d9a7 server.py: crude reactor 2024-04-27 23:14:11 +01:00
ochafik 59b411406f server.py: refactor chat handlers 2024-04-27 23:14:11 +01:00
ochafik 5f3de16116 server.py: pass all request options, comments in ts sigs, render tool calls 2024-04-27 23:14:11 +01:00
ochafik 63a384deaf server.py: raise n_predict 2024-04-27 23:14:11 +01:00
ochafik a4062935a5 server.py: reenable grammar, accommodate mistral's escaped underscores 2024-04-27 23:14:11 +01:00
ochafik aa9605c751 server.py: kinda api-compliant output, disabled grammar 2024-04-27 23:14:11 +01:00
ochafik 8afd4de17b server.py: make tools work w/ mixtral-8x7b-instruct 2024-04-27 23:14:11 +01:00
ochafik d5d9993679 server.py: default tools work! 2024-04-27 23:14:11 +01:00