Battery

What do you mean by battery of prompts? 👀

I think it's similar to what I'm doing, sending an array of questions to the query engine and generate a report from answers

@costlySignal for me it cost a lot, so I decided to build on opensource models using aws fargate spot instances. I'm working as devops engineer, I think i can make it in a very cost efficient way

How large is your array? I’m thinking I will have 20-30 per document.

I will also make follow up questions. Some questions will return lists and then I will re-feed each item to the model asking for more details.

@Simonas

I have around 50 questions per document, probably i need to chain them as well, but I hit a rate limit on openapi, so I decided to try opensource models