I'm not able to replicate this. Are you running mypy with any particular arguments/settings?
I know the packages still need py.typed files sadly, so you might have to set
--ignore-missing-imports
For example
(venv) loganmarkewich@Logans-MBP test_install % mypy .
app.py:2: error: Skipping analyzing "llama_index.embeddings.openai": module is installed, but missing library stubs or py.typed marker [import-untyped]
app.py:2: note: See https://mypy.readthedocs.io/en/stable/running_mypy.html#missing-imports
app.py:3: error: Skipping analyzing "llama_index.llms.openai": module is installed, but missing library stubs or py.typed marker [import-untyped]
Found 2 errors in 1 file (checked 1 source file)
(venv) loganmarkewich@Logans-MBP test_install % mypy --ignore-missing-imports .
Success: no issues found in 1 source file