ochafik
|
2ecc2ae900
|
grammars: update performance gotchas w/ repetition advice
|
2024-04-20 01:25:58 +01:00 |
|
ochafik
|
1fb778750f
|
Merge remote-tracking branch 'origin/master' into grammar-reps
|
2024-04-15 18:57:43 +01:00 |
Olivier Chafik
|
ab9a3240a9
|
JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)
* json: rename python schema converter to make import easier
* server: skip null json_schema / grammar fields
* json: deps management for primitive rules (+ allow null values)
* json: optimize repetitions for minItems/maxItems and regexps: `a{,3}` goes from `"a"? "a"? "a"?` (explosive combos) to `(a (a (a)?)?)?`
* grammars: add troubleshooting section to readme
* json: cap length of numbers to 15 digits before/after decimal point
(avoids infinite gen, e.g. "one third" -> `0.333333333333...`)
* json: unify all repetition code (w/ or w/o sep)
* json: support string minLength/maxLength
* server+json: update server/README w/ result_format
* nits
* json: fix type error w/ python 3.8
* json: fix server/README (json_schema in /completion vs. result_format in /v1/chat/completions)
* json: simplify DOT `{"type": "string", "pattern": "^.$"}`
* json: remove recursion in opt_repetitions (avoids Python stack overflow)
* json: rm dead code
* json: rm useless assert & ggml.h import
|
2024-04-12 19:43:38 +01:00 |
|
Olivier Chafik
|
9d8efa545f
|
grammars: disallow `a{,}` (not allowed in regexps)
|
2024-04-12 18:10:50 +01:00 |
|
Olivier Chafik
|
9d9b5a34f6
|
grammars: nit
|
2024-04-12 16:17:36 +01:00 |
|
Olivier Chafik
|
de0fd3f7f0
|
grammars: document new repetition operators
|
2024-04-12 16:12:16 +01:00 |
Richard Kiss
|
532dd74e38
|
Fix some documentation typos/grammar mistakes (#4032)
* typos
* Update examples/parallel/README.md
Co-authored-by: Kerfuffle <44031344+KerfuffleV2@users.noreply.github.com>
---------
Co-authored-by: Kerfuffle <44031344+KerfuffleV2@users.noreply.github.com>
|
2023-11-11 23:04:58 -07:00 |
Evan Jones
|
f5fe98d11b
|
docs : add grammar docs (#2701)
* docs : add grammar docs
* tweaks to grammar guide
* rework GBNF example to be a commented grammar
|
2023-08-22 21:01:57 -04:00 |