Find answers from the community

Updated 2 months ago

Battery

What is the best way to make a battery of prompts to a given index? I then want to compile the answers into a single document.
L
S
c
7 comments
What do you mean by battery of prompts? πŸ‘€
I think it's similar to what I'm doing, sending an array of questions to the query engine and generate a report from answers
@costlySignal for me it cost a lot, so I decided to build on opensource models using aws fargate spot instances. I'm working as devops engineer, I think i can make it in a very cost efficient way
How large is your array? I’m thinking I will have 20-30 per document.
I will also make follow up questions. Some questions will return lists and then I will re-feed each item to the model asking for more details.
I have around 50 questions per document, probably i need to chain them as well, but I hit a rate limit on openapi, so I decided to try opensource models
Add a reply
Sign up and join the conversation on Discord