Skip to content

Commit a28b8c8

Browse files
committed
server : update readme [no ci]
1 parent 5a699f1 commit a28b8c8

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

examples/server/README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -524,6 +524,12 @@ Takes a prefix and a suffix and returns the predicted completion as stream.
524524

525525
- `input_prefix`: Set the prefix of the code to infill.
526526
- `input_suffix`: Set the suffix of the code to infill.
527+
- `prompt`: Added after the `FIM_MID` token
528+
- `extra_context`: Additional context inserted before the FIM prefix. See https://github.com/ggerganov/llama.cpp/pull/9874
529+
530+
```txt
531+
[extra_context]<FIM_PRE>[input_prefix]<FIM_SUF>[input_suffix]<FIM_MID>[prompt]
532+
```
527533

528534
It also accepts all the options of `/completion`.
529535

0 commit comments

Comments
 (0)