Different approach, which also works with Llama 3.0 8B: let the LLM write the tool invocation of choice in Python syntax, parse the LLM response with the Python AST package. (PoC'y hackathon demo) code here: https://github.com/ndurner/aileen2.

https://ollama.com/blog/tool-support Ollama enables tool support for a variety of models now as well, including Llama-3.1.

So do most LLMs now days, no?

[dead]

[dead]