Find answers from the community

Updated 4 months ago

Llama2

At a glance

The community member is wondering if it might be straightforward to implement a Q&A system using llama2 instead of GPT-x with the llamaindex library. Another community member responds by providing a demo using a llama2 instance from Replicate and notes that it's important to properly format the llama-2 prompts, providing a link to the relevant code. The second community member expresses appreciation for the information.

Useful resources
hi all I'm wondering if it might be straightforward to do a q&a implementation of llama2 instead of gpt-x usiing llamaindex?
L
v
2 comments
We have a demo here using a llama2 instance from Replicate

https://github.com/jerryjliu/llama_index/blob/main/docs/examples/vector_stores/SimpleIndexDemoLlama2.ipynb

Note the llama utils extra functions imported to transform the prompts

It's really important llama-2 prompts are formatted proper we found
https://github.com/jerryjliu/llama_index/blob/main/llama_index/llms/llama_utils.py
Thats actually really good to know. thanks a lot
Add a reply
Sign up and join the conversation on Discord