Find answers from the community

m
mkern
Offline, last seen 2 months ago
Joined September 25, 2024
anyone know how one can apply a simple transform to a prompt before retrieval, but use the actual prompt for LLM generation?
2 comments
m
L
what would be the best way to use OpenAIPydanticProgram in response synthesis from an index?
4 comments
L
m
is it possible to run multiple distinct queries in parallel?
I've noticed that aquery seems to block execution, even with asyncio code

Plain Text
    async def query(i):
        return await query_engine.aquery(...)

    tasks = [query(i) for i in range(10)]
    sections = await asyncio.gather(*tasks)
7 comments
m
j