Find answers from the community

Updated 2 years ago

Movie recs

Can Anyone help me, please? I am working on a project, where I have too many movie's description, including movie name, type of movie(romantic, horror etc) description etc. I have all this data in form of text. I have too many text files each movies.

Now, the thing I want to perform here is:

  1. Split this data using textSplitter.
  1. Store in pineconeStore with openai gpt-3.5 embedding.
  1. Now, for example when user ask for: "show me list of romantic movies" then, provide him list of romantic movies.
Issue: Because of there is no relationship between the split documents, and having movie type and movie name in different documents, I get the result that there is a romantic movie, "but as the name is in different document, I am not able to get the name of the movie."

Can you please help me out regarding this?
L
1 comment
Personally, I would preprocess the text make each set of details for each movie its own document object

Then when you query, you can set the top k a little high, to get the most relevant results to the query
Add a reply
Sign up and join the conversation on Discord