drewskidang

@Logan M also AttributeError: 'Anthropic' object has no attribute 'get_tokenizer'
do we have fix for this or do we not use tokziner for anthropic anymore

17 comments

ddrewskidang

Entity Extraction with LLMs: Addressing Challenges

can we use entity extraction with llms? Gettign issues with bert

5 comments

ddrewskidang

Unexpected Keyword Argument 'use_beam_search'

using vllm and getting some issues
TypeError: Unexpected keyword argument 'use_beam_search'

7 comments

ddrewskidang

Integrating real-time voice assistant

Any plans to integrate real time voice assistant. I got some free time building again if even needed.

3 comments

ddrewskidang

Plans to integrate anthropics with other models for faster computation

Any plans of doing anthropics rag context with other models. Its so slow bc i tier 1 for anothropic

7 comments

ddrewskidang

isn't the anthropic rag chunk thing

isn't the anthropic rag chunk thing really similar to the meta data summary extractor?

Adding more context to the chunk?

8 comments

ddrewskidang

Span marker

Plain Text

    437             The target length or query length the created mask shall have.
    438     """
--> 439     _, key_value_length = mask.shape
    440     tgt_len = tgt_len if tgt_len is not None else key_value_length
    441 

ValueError: too many values to unpack (expected 2)

Having trouble with the entity extractor

1 comment

ddrewskidang

Does llama support llms as embedding lol

Does llama support llms as embedding lol. I just want to compare the difference bc of the leader boards

1 comment

ddrewskidang

SOmeoby help please

Plain Text

completion_response = model.complete("To infinity, and")
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv\Lib\site-packages\text_generation\client.py", line 154, in chat
    raise parse_error(resp.status_code, payload)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  ext_generation\errors.py", line 81, in parse_error
    message = payload["error"]
              ~~~~~~~^^^^^^^^^
KeyError: 'error'

6 comments

ddrewskidang

How do I interstate cache with Qdrant. I want to story my queries.

9 comments

ddrewskidang

llamaindex-embedding-lora/finetune_embed...

if we are using an llm for embeddings do we just pass the llm into the huggingface_https://github.com/marib00/llamaindex-embedding-lora/blob/main/finetune_embedding_lora.ipynb

9 comments

ddrewskidang

b'{"status":{"error":"Wrong input:

b'{"status":{"error":"Wrong input: Vector params for text-sparse are not specified in config"},"time":0.000035159}'
Can someone help im confused

i have both but am i doing something wrong?

7 comments

ddrewskidang

Kwargs

"do_sample": True,
"temperature": 0.6,
"top_p": 0.9,
},

Is there a way to add this in the openailike class....I tried additonal kwargs but no avail

1 comment

ddrewskidang

Metadata

what are requriments for the custom meta data extractor

1 comment

ddrewskidang

Llms

does llama-index support gemeni pro experimental or command-r/r+

8 comments

ddrewskidang

so im using llm sherpa as my parser and

so im using llm sherpa as my parser and it does the chunks already is there a way to keep the chunks size when converting to nodes?

8 comments

ddrewskidang

Is raptor ment for pdfs. I have a nest

Is raptor ment for pdfs. I have a nest xml files and also not sure what splitter is best for xml files

1 comment

ddrewskidang

AttributeError: 'TransformQueryEngine'

AttributeError: 'TransformQueryEngine' object has no attribute 'chat'

10 comments

ddrewskidang

Pinecone

is it possible to use a knowledge graph wiht pine cone ubt looking examples but it looks likek the vectostores are local?

1 comment

ddrewskidang

having trouble importing this

having trouble importing this
'''
from llama_index.core.program import (
DFFullProgram,
DataFrame,
DataFrameRowsOnly,
)
;;;

8 comments

ddrewskidang

from llama_index.core.response import

from llama_index.core.response import StreamingResponse
i cant impore this for somereason

16 comments