Find answers from the community

Updated 11 months ago

Hi folks. I made LLM application using

Hi folks. I made LLM application using LlamaIndex. Next step is the deployment. What is the best way to deploy it using AWS? Could you please share your experience for me?
a
Z
4 comments
Nice @ZIRU:

Without knowing too much of the details, high-level steps of docker'izing pushing to ECR and deploying with EKS or ECS?

Or maybe you want to go serverless and go down the path of AWS lambda?
I am looking for easy way just for POC.
Which one is more easy to set up?
Can I deploy using ECR ONLY?
ECR would be you pushing up your docker container to a remote repository. Perhaps something like this will be helpful: https://www.philschmid.de/aws-lambda-with-custom-docker-image
Add a reply
Sign up and join the conversation on Discord