I finally have a script up and running using a LLM other than OpenAI. I am providing the script 1 PDF that is roughly 300 pages. The answer I'm getting has 2 problems:
- It's hallucinating it's opening sentence
- The list it provides is accurate, but repeated over and over. So What should be a list of 9 items is 35 of the same thing repeating.
I have a feeling perhaps I have something out of order or I am missing a step. I had a hard time cobbling everything together where I could get an output.