node-llama-cpp

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on

embeddingsaidevelopment
2,027 stars185 forksTypeScript

Installation Guide

Complexity:Easy

Prerequisites

  • TypeScript installed
# Installation\n\n```bash\ngit clone https://github.com/withcatai/node-llama-cpp.git\ncd node-llama-cpp\n```\n\nSee https://github.com/withcatai/node-llama-cpp for detailed instructions.

Quick Commands

git clone https://github.com/withcatai/node-llama-cpp.git