Find answers from the community

Updated 3 months ago

Memory

Is someone seeing an increase in memory during boot after moving to v.10.0, my application is showing 200mb increase per class init after depending on v0.10.x vs. 0.9.x (it could be just me though)

3 comments

LLogan M

I have not really seen this. I know the main source memory usage will be tiktoken, unless you are running local models

zzanetworker

I am not running local models for this use-case, but all was fixed except changing imports which made me question.

zzanetworker

I will do more research in the mean time, thanks!

Add a reply