Validation error IngestionPipeline

eemmepra

i'm trying to deploy my IngestionPipeline using ChromaVectorStore and TextEmbeddingsInference both containerized as docker services but i'm getting the following issues:

Plain Text

ValidationError                           Traceback (most recent call last)
...
ValidationError: 2 validation errors for IngestionPipeline
transformations -> 1
  Can't instantiate abstract class TransformComponent with abstract method __call__ (type=type_error)
vector_store
  Can't instantiate abstract class BasePydanticVectorStore with abstract methods add, client, delete, query (type=type_error)

this is how i setup the pipeline:

Plain Text

vector_store = ChromaVectorStore(host="localhost", port=8000, chroma_collection="articles")

ingestion_pipeline = IngestionPipeline(
    transformations=[
        TokenTextSplitter(chunk_size=512),
        TextEmbeddingsInference(
            base_url='http://localhost:8001',
            embed_batch_size=10,
            model_name="BAAI/bge-small-en-v1.5"
        ),
    ],
    vector_store=vector_store,
)

10 comments

eemmepra

@WhiteFang_Jr any thought on this?

WWhiteFang_Jr

Not much 🙏 , We will have to wait for Logan on this.

eemmepra

Thanks! @Logan M I owe you far too much ahah

WWhiteFang_Jr

We all do!😆

LLogan M

Are you using .legacy import anywhere? Need to be sure to use all .legacy or none at all

eemmepra

it was a mix of core and legacy, just tried. Now it's working!!

eemmepra

but let me take the opportunity to ask you what is the ratio between legacy and core definitions

eemmepra

apparently i've been away from llamaindex for too long ahah

LLogan M

legacy is just a backport of v0.9.48, to help people who don't want to migrate their code.

So you can use all llama_index.legacy imports to make it more like using v0.9.48

LLogan M

Eventually, this will be removed though (not for several months anyways)

Add a reply

Find answers from the community

Validation error IngestionPipeline