llama.cpp supports custom grammars to constrain inference. maybe this is a helpf...

		khimaros on Jan 14, 2024 \| parent \| context \| favorite \| on: Building a fully local LLM voice assistant to cont... llama.cpp supports custom grammars to constrain inference. maybe this is a helpful starting point? https://github.com/ggerganov/llama.cpp/tree/master/grammars