deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43.3K Stars

⑂ 5.1K Forks

○ 43.3K Watchers

✖ 1.6K Issues

Python

billion-parameters compression data-parallelism deep-learning gpu inference machine-learning mixture-of-experts model-parallelism pipeline-parallelism pytorch trillion-parameters zero

Last push: 10h ago

Created:

↗ View on GitHub

Loading additional information…