Is there a way to implement a json file

VVaylonn

Is there a way to implement a json file as input containing a lot of information such as the context, the prompt, the index to choose or the model as well as the history and to output another json file containing as before the chosen index, the model and a history containing the context, and the exchanges between the user and the ia? It seems to me that this is possible via a POST request with flask for a web app and using Postman too. Thanks for your help!

here is the schema of the json file i thought off:

{
    "Prompt": "my text",
    "Index": "my_index",
    "Model": "test1",
    "History": [{
            "Type": "System",
            "Prompt": "some text"
        }, {
            "Type": "User",
            "Prompt": "some text"
        }, {
            "Type": "Assistant",
            "Prompt": "some text"
        }
    ]
}

 

------------------------------------
{
    "IsError": false,
    "Error": null,
    "Result": {
        "Prompt": "the_prompt",
        "Index": "my_index",
        "Model": "test1",
        "History": [{
                "Type": "System",
                "Prompt": "some text"
            }, {
                "Type": "User",
                "Prompt": "some text"
            }, {
                "Type": "Assistant",
                "Prompt": "some text"
            }, {
                "Type": "User",
                "Prompt": "some text"
            }, {
                "Type": "Assistant",
                "Prompt": "prompt result"
            }            
        ]
    }
}

11 comments

WWhiteFang_Jr

What is the use of context?

WWhiteFang_Jr

You can use any python framework to create POST endpoint and pick out the query and run it against the query_engine and once the response is returned. You can create a JSON response as per your requirement

VVaylonn

Yeah i managed to foud out how everything is working with POST request, It's because i have a app in C# where i wanted to implement my program with llama_index and the easiest way i found was to get or send a json file to my C# app

VVaylonn

Now i'm trying to implement the serialisation or to deal with the history part, i don't know how to do it :/

WWhiteFang_Jr

llama_index is supported in C# ? That's great. Didn't know that

VVaylonn

no it's not haha !

VVaylonn

that's why i want to format my output in a json file !

VVaylonn

in order to be used in my C# app

WWhiteFang_Jr

You can try this approach

Plain Text

var client = new HttpClient();
var request = new HttpRequestMessage();
request.RequestUri = new Uri("http://localhost:8000/api/v1/bot/ChatBot-Widget");
request.Method = HttpMethod.Post;

request.Headers.Add("Accept", "*/*");
request.Headers.Add("User-Agent", "Thunder Client (https://www.thunderclient.com)");

var bodyString = "{  \"question\": \"your_own_query\"}";
var content = new StringContent(bodyString, Encoding.UTF8, "application/json");
request.Content = content;

var response = await client.SendAsync(request);
var result = await response.Content.ReadAsStringAsync();
Console.WriteLine(result);

WWhiteFang_Jr

You can use this to hit to your python server and get back the JSON output

WWhiteFang_Jr

This will remove the need for Json file in my opinion

Add a reply

Find answers from the community

Is there a way to implement a json file