Can we use llama index with open source

Of course! You can use any langchain LLM. We also have integrations with llama.cpp, huggingface, and a bunch of other open source LLM libraries

https://gpt-index.readthedocs.io/en/stable/core_modules/model_modules/llms/modules.html