Question on the callback manager. Currently in my app, when I start it, I initialize it with
Settings.callback_manager = callback_manager
where callback_manager just has, llama_debug, tokencountinghandler in Django.
- How can I import it correctly because when I try to use import Settings, and try to access Settings.callback_manager in a different file, it ignores what I setup globally and starts its own callback_manager.
- Am I suppose to be starting an instance of token_counter per API request? If 2 API requests happen at the same time, I assume it'll conflict so... maybe I can't really use Settings.callback_manager globally? π€