Find answers from the community

Updated last year

Llm

At a glance

The community member asked how to integrate DeepInfra with LlamaIndex. Another community member responded that there is currently no DeepInfra integration, but suggested creating a custom LLM class or using one of the many LLM options available in the LlamaIndex documentation. The second community member simply replied "thanks".

Useful resources

ssha-sy

@Logan M How can we integrate DeepInfra with llama index?

2 comments

LLogan M

There's no deepinfra integration right now

If you wanted, you could create a custom llm class
https://docs.llamaindex.ai/en/stable/module_guides/models/llms/usage_custom.html#example-using-a-custom-llm-model-advanced

Or use one of the many llm options available
https://docs.llamaindex.ai/en/stable/module_guides/models/llms.html#modules

ssha-sy

thanks

Add a reply