I am trying to use HuggingFaceLLMPredictor class with starchat-beta model. How do I decide on the value of two params - max_input_size and max_new_tokens?
I tried to look for guidelines in the documentation but did not find any.
Thank you.