Commit 03fb8a0
authored
If first token generated from the server is the stop word the server will crash (ggml-org#7038)
This will reproduce the issue in llama13b
{
'prompt': 'Q: hello world \nA: ',
'stop': ['\n'],
'temperature': 0.0,
'n_predict': 10,
'cache_prompt': True,
'n_probs': 10
}1 parent 92139b9 commit 03fb8a0
1 file changed
+2
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1383 | 1383 | | |
1384 | 1384 | | |
1385 | 1385 | | |
| 1386 | + | |
1386 | 1387 | | |
1387 | 1388 | | |
1388 | | - | |
| 1389 | + | |
1389 | 1390 | | |
1390 | 1391 | | |
1391 | 1392 | | |
| |||
0 commit comments