airllm lyogavin

AirLLM 70B inference with single 4GB GPU

Language
Jupyter Notebook
Stars
30,779
Forks
3,273

Tags

  • 库/SDK
  • 推理优化
  • 深度学习
  • 本地部署
  • Python

README

![airllm_logo](https://github.com/lyogavin/airllm/blob/main/assets/airllm_logo_sm.png?v=3&raw=true) [**Quickstart**](#quickstart) | [**Configurations**](#configurations) | [**MacOS**](#macos) | [**Example notebooks**](#example-python-notebook) | [**FAQ**](#faq) **AirLLM** dramatically reduces infer…

查看完整页面