LlamaIndex
Log in

Find answers from the community

Updated last year

Hi all, can anyone guide me on how to

TTL
·
Hi all, can anyone guide me on how to use llama index with aws bedrock when in a deployed ecs environment? There is a profile param and I can also pass in keys and tokens to the Bedrock class but is there a way to just do this with IAM?
L
T
3 comments
LLogan M
I know next to nothing about using bedrock, BUT heres the constructor code
https://github.com/run-llama/llama_index/blob/780b71d7128f5b373466b7fc0baafa4aa617f77c/llama_index/llms/bedrock.py#L69

If something is missing with how credentials are working, feel free to make a PR!
TTL
Okay so it looks like in a deployed env, it falls back to IAM permissions rather than a profile param or any key or token params
TTL
This is the default behavior of when aws services are invoked via boto3 btw so that's good and expected behavior!
Add a reply
Sign up and join the conversation on Discord