Yea that is a bigger job π You are welcome to work on it. Technically some of the prompts are already "pre-filled", like the core RAG prompts. Although this really only applies to non-chat models I think?
Not every LLM supports stop tokens either
This general setup could be introduced as a new agent maybe?
changing these base classes is always a huge ton of work, so thats my main reason for not jumping on this π Hard to prioritize it in favor of other things personally, but as always, community PRs are welcome