Instruct Template

[riccardomusmeci]

Hi there, looking at OpenELM instruct template what I understood is that the template is something like this:

<|system|>
You are a helpful AI assistant.
<|user|>
How to explain Internet for a medieval knight?
<|assistant|>

Is that right? With MLX the model is not properly working on instruct mode.

[louis845]

Yes, this would be really useful. I am trying to use the OpenELM instruct models but I can't find out what the instruct template is.

[purefall]

Is there any update regarding the chat template and tokenizer used for instruction tuning?

Especially when using OpenELM 1.1B Instruct models from Huggingface, I only get "<<<<<<" as the output.

I used tokenizer of "meta-llama/Llama-2-7b-hf" and original template from Llama2, but the output is garbage.... It would be great if you can clarify

[SongTonyLi]

I'm also confused here. If indeed we need to use meta-llama/Llama-2-7b-hf chat template, so why does the source code also include another different chat template?