Find answers from the community

Updated 2 months ago

Hi All, I am using Bedrock + llamaindex

Hi All, I am using Bedrock + llamaindex. I want to keep running long sessions, but the Bedrock credentials are getting expired by every n hours. Is there any feature in llamaindex Bedrock class to enable long sessions (or to keep refreshing the sessions automatically)?
L
s
4 comments
Like, the credentials need to be changed or the client just needs to be refreshed?
You could probably make a PR that uses a new client for each LLM call -- we added a similar option to the openai LLM recently.

Or, maybe there's something smarter like checking a "time since initialized" variable before each API call and refreshing as needed
I think that the client just needs to be refreshed. using the roles to extract credentials.
Add a reply
Sign up and join the conversation on Discord