Find answers from the community

Updated 2 months ago

Hi All, I am using Bedrock + llamaindex

Hi All, I am using Bedrock + llamaindex. I want to keep running long sessions, but the Bedrock credentials are getting expired by every n hours. Is there any feature in llamaindex Bedrock class to enable long sessions (or to keep refreshing the sessions automatically)?

4 comments

LLogan M

Like, the credentials need to be changed or the client just needs to be refreshed?

LLogan M

You could probably make a PR that uses a new client for each LLM call -- we added a similar option to the openai LLM recently.

Or, maybe there's something smarter like checking a "time since initialized" variable before each API call and refreshing as needed

ssamtube405

I think that the client just needs to be refreshed. using the roles to extract credentials.

LLogan M

Here's the source code, if you wanted to make a PR 🙂 https://github.com/run-llama/llama_index/blob/ed8ce291c04eca30676bc6b3e9a0eb6a64476a35/llama_index/llms/bedrock.py#L58

Add a reply