Find answers from the community

Updated last year

Query

At a glance

I built my query engine locally which took around 2 hrs. Now when I send in a query, it takes roughly the same amount of time to generate the response. Is this behaviour correct or am I missing something ?

Attachment

rn_image_picker_lib_temp_ecc655b9-43c8-4ca4-a662-4e2a46170ca1.jpg

3 comments

LLogan M

Are you running a local LLM on CPU?

GGhostRider

Yes 😅

LLogan M

That would be why lol

Add a reply