Running on Mac systems

[morfien101]

Can this run on a mac based system?

I splashed about a bit trying to get it to run but ultimately the models would fail to run since they couldn't gain access to the GPU on my macbook pro inside the docker container.

Since there are multiple components it tricky to get running outside the containers.

If it is possible it would be great if there was instructions on how to do it. I only see instructions for Intel, AMD and Nvidia card based systems.

[richiejp]

Short answer is it should work, but you are on your own a bit until someone is able to document it.

I don't know if LocalAI will run inside a container on Mac. So you would have to set that up separately: https://localai.io/installation/macos/

The other components in the docker compose file should run fine. So you could run LocalAI natively then create a compose file that extends the LocalAGI service with a different value set for LOCALAGI_LLM_API_URL.