Matrix connector formats messages improperly

[ericomeehan]

It is using Markdown format, but the posted messages are appearing in rooms as raw text.

[richiejp]

You may need to set a custom prompt for the LLM saying that it should not use Markdown and with some smaller LLMs they may ignore this. Possibly the connector itself could add this to the prompt, but I'm not a huge fan of this, especially as it's possible to fine-tune an LLM to never return markdown.

If there isn't an LLM fine-tuned for this purpose then we could create one, the problem is finding the time.

[ericomeehan]

You may need to set a custom prompt for the LLM saying that it should not use Markdown and with some smaller LLMs they may ignore this. Possibly the connector itself could add this to the prompt, but I'm not a huge fan of this, especially as it's possible to fine-tune an LLM to never return markdown.

If there isn't an LLM fine-tuned for this purpose then we could create one, the problem is finding the time.

Thanks for the reply. My Matrix rooms actually support markdown, though, which is why I found it odd that they were not displaying properly here. I had originally used Baibot for this with the same LLM and the output displayed correctly.