how to integrate a model running on

You can use the customLLM class from LlamaIndex to use custom LLM.

for ref:
https://gpt-index.readthedocs.io/en/stable/core_modules/model_modules/llms/usage_custom.html#example-using-a-custom-llm-model-advanced