Error while installing python package: llama-cpp-python

May 2024 · 2 minute read

Publish date: 2024-01-08

I am using Llama to create an application. Previously I used openai but am looking for a free alternative. Based on my limited research, this library provides openai-like api access making it quite easy to add into my prexisting code. However this library has errors while downloading. I tried installing cmake which did not help.

Building wheels for collected packages: llama-cpp-python Building wheel for llama-cpp-python (pyproject.toml) ... error error: subprocess-exited-with-error × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [20 lines of output] *** scikit-build-core 0.5.1 using CMake 3.27.7 (wheel) *** Configuring CMake... 2023-10-10 21:23:02,749 - scikit_build_core - WARNING - Can't find a Python library, got libdir=None, ldlibrary=None, multiarch=None, masd=None loading initial cache file C:\Users\ARUSHM~1\AppData\Local\Temp\tmpf1bzj6ul\build\CMakeInit.txt -- Building for: NMake Makefiles CMake Error at CMakeLists.txt:3 (project): Running 'nmake' '-?' failed with: The system cannot find the file specified CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage -- Configuring incomplete, errors occurred! *** CMake configuration failed [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for llama-cpp-python Failed to build llama-cpp-python ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects 

Although not directly related to this question, these are other questions I am unable to get answers for:

  • Does this library use Llama or Llama 2?
  • Will this be secure on a Python Flask Application?
  • 1

    2 Answers

    You need to install the desktop c++ block with visual studio to get cmake properly installed.Open the Visual Studio Installer and click Modify, then check Desktop development with C++ and click Modify to start the install. I also recommend the Windows 10 SDK. https://learn.microsoft.com/en-us/cpp/build/cmake-projects-in-visual-studio?view=msvc-170 https://developer.microsoft.com/en-us/windows/downloads/windows-sdk/ After that, !pip install llama-cpp-python should build just fine.

    1

    For this error message

     CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage 

    The gcc and g++ are NOT installed, and the version of GCC should be over gcc 11 per this issue

    sudo apt update sudo apt upgrade sudo add-apt-repository ppa:ubuntu-toolchain-r/test sudo apt update sudo apt install gcc-11 g++-11 
    yum install scl-utils yum install centos-release-scl # find devtoolset-11 yum list all --enablerepo='centos-sclo-rh' | grep "devtoolset" yum install -y devtoolset-11-toolchain 
    sudo dnf install gcc sudo dnf install g++ 

    ncG1vNJzZmirpJawrLvVnqmfpJ%2Bse6S7zGiorp2jqbawutJobnBqZmyAdYKOnqmrp6JixKm1y55koqajqa6tuMinnmaoqam1sLqMqZico5Gcsm64y5qkmmWTpb1uvNitn6im

    ncG1vNJzZmick5bAb7%2FFqGlnnJmctrWty6ianpmeqL2ir8SsZZynnWSys77Oq2SwoJmhsm61zayrmqScnruoec%2Byq6GnnmK9oq%2FKmp6eZZyhrq6tjJynqWWgrsGpu81nn62lnA%3D%3D