https://github.com/zby/LLMEasyTools is my library that can generate schemas and dispatch function calls, but does not take control over. It is not affiliated with llamaindex though
Thanks @zby, this is exactly what I'm trying to achieve. If it's possible to do something similar with just llamaindex, I'll go that path just not to add a new dependency to my project. But yeah, if llamaindex doesn't support something like this, I'll probably add LLMEasyTools to my project. It's a nice api, simple and delivers what I expect.