← Back to directory
AutoGPTQ

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Agentllmaidevelopment
5,055 stars538 forks● Python
Visit WebsiteView on GitHub

Installation Guide

Complexity:Easy

Prerequisites

  • Python installed
# Installation\n\n```bash\ngit clone https://github.com/AutoGPTQ/AutoGPTQ.git\ncd AutoGPTQ\n```\n\nSee https://github.com/AutoGPTQ/AutoGPTQ for detailed instructions.

Quick Commands

git clone https://github.com/AutoGPTQ/AutoGPTQ.git