max_new_tokens can be anything you want, but the larger it is, the less room there will be in the overall context window. The default is 256, and that's usually good enough
max_input_size can be weird to find, huggingface doesn't make this easy. Looking at the starchat page on huggingface, it appears to be 8192
https://huggingface.co/HuggingFaceH4/starchat-beta/blob/b1bcda690655777373f57ea6614eb095ec2c886f/config.json#L23You can definitely set this lower though too, to help with speed/memory usage
