Ok. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started”

Iirc it can run anything llama.cpp can because it just uses that under the hood.

There’s also llamafile, super simple: download and run it.