- I created a documentation issue for a multi modal notebook that uses Replicate. Due to the structture of the for loops there is a HUGE penalty for cold boots. The recommended change improves performance significantly. (and likely make Replicate a bigger fan of LlamaIndex)
I recommend updating or removing references in your documentation to the Bottoms-Up development repository.
I have a lot of respect for the effort that went into this series and the quality of the instruction - it just doesn't match the current LllamaIndex implementation.