← Back to directory
PowerInfer

PowerInfer

High-speed Large Language Model Serving for Local Deployment

Ollamaaidevelopment
9,389 stars565 forks● C++
Visit WebsiteView on GitHub

Installation Guide

Complexity:Developer

Prerequisites

  • C++ installed
# Installation\n\n```bash\ngit clone https://github.com/Tiiny-AI/PowerInfer.git\ncd PowerInfer\n```\n\nSee https://github.com/Tiiny-AI/PowerInfer for detailed instructions.

Quick Commands

git clone https://github.com/Tiiny-AI/PowerInfer.git