Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated last month
0
Follow
Llamaindex workflow compatibility with Redpanda and Confluent
Llamaindex workflow compatibility with Redpanda and Confluent
Inactive
0
Follow
d
dean
last month
Β·
Does LlamaIndex Workflow work with Redpanda? Or it needs to be confluent?
L
d
12 comments
Share
Open in Discord
L
Logan M
last month
I've never used redpanda -- not sure what that would look like
d
dean
last month
It implements the Kafka protocol but is might lighter weight.
d
dean
last month
C++ and Raft impl of Kafka standard.
L
Logan M
last month
hmm, workflows don't use a message queue. Its all just single-process asyncio queues π
redpanda could be a llama-deploy integration in the future though, if the existing kafka message queue doesn't work with it
d
dean
last month
Ok
d
dean
last month
So do you need to install Kafka broker for it to work?
d
dean
last month
What's the minimum setup for Llama workflow that uses Kafka ?
d
dean
edited last month
I don't see any reason for a docker deployment why RedPanda could not substitute here
https://github.com/run-llama/llama_deploy/blob/main/docker/docker-compose-kafka.yml
d
dean
last month
Because it implements the Kafka protocol. Can you please check this. Thanks
L
Logan M
last month
I meant the code under the hood here is using kafka pypi libraries
https://github.com/run-llama/llama_deploy/blob/3d156c89599b1be6bfedc943adc54ebda2fb18d7/llama_deploy/message_queues/apache_kafka.py#L112
L
Logan M
last month
assuming the protocol is the same, i'd assume it just works π€·
d
dean
last month
Yes, that's what I am hearing from RedPanda as well. I think it should work
Add a reply
Sign up and join the conversation on Discord
Join on Discord