Find answers from the community

Updated 5 months ago

help pls

At a glance

The community member is experiencing an issue when trying to install the llama-cpp-python package using Poetry on Windows. The error message indicates a problem with the build process, specifically related to CMake configuration. The community members suggest that this is likely due to missing dependencies on the Windows system.

The comments provide some guidance, suggesting that the community member should follow the Windows-specific installation instructions for llama-cpp-python, which can be found on the project's GitHub page. Additionally, one community member suggests verifying the installation by running pip wheel --no-cache-dir --use-pep517 "llama-cpp-python (==0.2.23)".

Useful resources
help pls
Plain Text
(localGPT) C:\Users\ra\privateGPT>poetry install --with local
Installing dependencies from lock file

Package operations: 1 install, 0 updates, 0 removals

  β€’ Installing llama-cpp-python (0.2.23): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel

  *** scikit-build-core 0.8.0 using CMake 3.28.1 (wheel)
  *** Configuring CMake...
  2024-01-28 22:52:33,868 - scikit_build_core - WARNING - Can't find a Python library, got libdir=None, ldlibrary=None, multiarch=None, masd=None
  loading initial cache file C:\Users\ra\AppData\Local\Temp\tmpdj5n8yup\build\CMakeInit.txt
  -- Building for: NMake Makefiles
  CMake Error at CMakeLists.txt:3 (project):
    Running

     'nmake' '-?'

    failed with:

     no such file or directory


  CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage
  CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
  -- Configuring incomplete, errors occurred!

  *** CMake configuration failed


  at ~\localGPT\Lib\site-packages\poetry\installation\chef.py:164 in _prepare
      160β”‚
      161β”‚                 error = ChefBuildError("\n\n".join(message_parts))
      162β”‚
      163β”‚             if error is not None:
    β†’ 164β”‚                 raise error from None
      165β”‚
      166β”‚             return path
      167β”‚
      168β”‚     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with llama-cpp-python (0.2.23) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "llama-cpp-python (==0.2.23)"'.
L
r
3 comments
Seems like an env issue.

My guess is windows is missing some dependencies to install llama-cpp

You can follow windows specific instructions here
https://github.com/abetlen/llama-cpp-python#windows-notes
I don't quite understand you, if you have some file to edit.
LlamaCPP requires some special installation instructions when installing on windows. Try following the instructions on the link first
Add a reply
Sign up and join the conversation on Discord