Find answers from the community

Updated 2 years ago

`aquery()` doesnot work async

seems like aquery() does not work as expected. I've mentioned more here https://github.com/jerryjliu/llama_index/issues/6463

4 comments

jjjmachan

can I'll take a stab at fixing this since it comes down to actually implementing BaseResponseBuilders but I had another feature request too.

Would it be possible to consider batching querries as well?

Plain Text

query_engine.query(question: list[str])

jjjmachan

this would be neat since openai api supports batching and models preffer batching for I'm not sure how generalizable it is

LLogan M

batching would definitely be cool! Also thanks for identifying that bug, an PR would be amazing 🙏

jjjmachan

already working on it 😉

Add a reply