```pydantic.error_wrappers.ValidationError: 1 validatio...

Plain Text

pydantic.error_wrappers.ValidationError: 1 validation error for IngestionPipeline
transformations -> 0
  value is not a valid dict (type=type_error.dict)

Plain Text

ingestion_pipeline = IngestionPipeline(
    transformations=[AzureOpenAIEmbedding]
    , vector_store=vector_store
)

ingestion_pipeline.run(documents=new_docs, show_progress=True)

The code above throws the error at the top. Not sure why, and I haven't been able to find much online. I am not superrrr familiar with pydantic so thats probably why I'm struggling. Any help?

?

17 comments

kkapa.ai

Please stand by @no_dice as I search the knowledge base. I normally take about 20 seconds or so. :wave:

kkapa.ai

----------------------
Based on the information provided in the extracts, it seems like the transformations parameter in the IngestionPipeline expects a list of transformation instances, not just the class names.

In the extracts, there is no direct example of using AzureOpenAIEmbedding in the IngestionPipeline. However, there are examples of using other transformations and embeddings. For instance, in the document management pipeline example (), transformations are used like this:

Plain Text

pipeline = IngestionPipeline(
    transformations=[...], docstore=SimpleDocumentStore()
)

In the Azure Cognitive Search example (), an embedding model is instantiated before being used:

Plain Text

embed_model = OpenAIEmbedding()

Based on these examples, you might need to instantiate AzureOpenAIEmbedding before using it in the IngestionPipeline. However, without the exact usage of AzureOpenAIEmbedding in the provided extracts, I can't provide a confident answer. I recommend checking the LlamaIndex documentation or source code for more information on how to use AzureOpenAIEmbedding in the IngestionPipeline.
----------------------
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
----------------------

LLogan M

The error is basically saying that transformations at position 0 is not a pydantic object

Are you using azure embeddings class from llama_index? Or from langchain?

nno_dice

I see. No I wasn't but I'm moving it over from llama_index now

nno_dice

Ah, its langchain...

LLogan M

Using llama kndex embeddings shouuuuld fix the issue.

Each item in the transformations list needs to inherit from the TransformComponent base class (which our embeddings do) -- otherwise pydantic will complain about the type

nno_dice

Damn, using the LlamaIndex embeddings is giving me that 404 error again

nno_dice

>.>

nno_dice

So close yet so far

LLogan M

You followed the guide? Setup might be ever so different from lamgchain

https://docs.llamaindex.ai/en/stable/examples/customization/llms/AzureOpenAI.html

nno_dice

I got lots of errors.

nno_dice

Gonna post em in the morning