Find answers from the community

Updated 2 years ago

Is there a way to increase response

Is there a way to increase response length with GPTSimpleVectorIndex? I think the standard max is 256 tokens?

4 comments

Plain Text

      # define prompt helper
      # set maximum input size
      max_input_size = 8000
      num_output = 500
      max_chunk_overlap=50
      prompt_helper = PromptHelper(max_input_size, num_output, max_chunk_overlap)

bbmax

Plain Text

      return GPTSimpleVectorIndex(
        documents, llm_predictor=llm_predictor, prompt_helper=prompt_helper
      )

TTeemu

Thank you!

jjerryjliu0

yep! depending on your LLM there's an easier way to do that https://gpt-index.readthedocs.io/en/latest/how_to/custom_llms.html#example-changing-the-number-of-output-tokens-for-openai-cohere-ai21

Add a reply