Update Colossal AI docs and integration #16778

awaelchli · 2023-02-15T23:37:37Z

What does this PR do?

The colossal-ai repo is now public: https://github.com/Lightning-AI/lightning-colossalai and pending a pypi release.
The readme + documentation gets updated on both sides and getting cross-linked.

cc @Borda @carmocca @akihironitta

for more information, see https://pre-commit.ci

docs/source-pytorch/advanced/model_parallel/model_parallel.rst

…salai

docs/source-pytorch/advanced/model_parallel/colossalai.rst

github-actions · 2023-02-16T05:22:51Z

⚡ Required checks status: All passing 🟢

Groups summary

🟢 pytorch_lightning: Tests workflow

Check ID	Status
pl-cpu (macOS-11, lightning, 3.8, 1.11)	success	✅
pl-cpu (macOS-11, lightning, 3.9, 1.12)	success	✅
pl-cpu (macOS-11, lightning, 3.10, 1.13)	success	✅
pl-cpu (macOS-11, lightning, 3.8, 1.11, oldest)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.9, 1.11)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.10, 1.12)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.10, 1.13)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.8, 1.11, oldest)	success	✅
pl-cpu (windows-2022, lightning, 3.9, 1.11)	success	✅
pl-cpu (windows-2022, lightning, 3.10, 1.12)	success	✅
pl-cpu (windows-2022, lightning, 3.10, 1.13)	success	✅
pl-cpu (windows-2022, lightning, 3.8, 1.11, oldest)	success	✅
pl-cpu (macOS-11, pytorch, 3.8, 1.13)	success	✅
pl-cpu (ubuntu-20.04, pytorch, 3.8, 1.13)	success	✅
pl-cpu (windows-2022, pytorch, 3.8, 1.13)	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 pytorch_lightning: Azure GPU

Check ID	Status
pytorch-lightning (GPUs)	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 pytorch_lightning: Benchmarks

Check ID	Status
pytorch-lightning.Benchmark	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 pytorch_lightning: Azure HPU

Check ID	Status
pytorch-lightning (HPUs)	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 pytorch_lightning: Azure IPU

Check ID	Status
pytorch-lightning (IPUs)	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 pytorch_lightning: Docs

Check ID	Status
make-doctest (pytorch)	success	✅
make-html (pytorch)	success	✅

These checks are required after the changes to docs/source-pytorch/advanced/model_parallel.rst, docs/source-pytorch/advanced/third_party/colossalai.rst, docs/source-pytorch/extensions/strategy.rst, requirements/pytorch/strategies.txt.

🟢 pytorch_lightning: Docker

Check ID	Status
build-cuda (3.9, 1.11, 11.3.1)	success	✅
build-cuda (3.9, 1.12, 11.6.1)	success	✅
build-cuda (3.9, 1.13, 11.7.1)	success	✅
build-hpu (1.5.0, 1.11.0)	success	✅
build-ipu (3.9, 1.13)	success	✅
build-NGC	success	✅
build-pl (3.9, 1.11, 11.3.1)	success	✅
build-pl (3.9, 1.12, 11.6.1)	success	✅
build-pl (3.9, 1.13, 11.7.1)	success	✅
build-xla (3.8, 1.12)	success	✅

These checks are required after the changes to dockers/base-cuda/Dockerfile, dockers/nvidia/Dockerfile, requirements/pytorch/strategies.txt.

🟢 mypy

Check ID	Status
mypy	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 install

Check ID	Status
install-pkg (ubuntu-22.04, app, 3.8)	success	✅
install-pkg (ubuntu-22.04, app, 3.10)	success	✅
install-pkg (ubuntu-22.04, fabric, 3.8)	success	✅
install-pkg (ubuntu-22.04, fabric, 3.10)	success	✅
install-pkg (ubuntu-22.04, pytorch, 3.8)	success	✅
install-pkg (ubuntu-22.04, pytorch, 3.10)	success	✅
install-pkg (ubuntu-22.04, lightning, 3.8)	success	✅
install-pkg (ubuntu-22.04, lightning, 3.10)	success	✅
install-pkg (ubuntu-22.04, notset, 3.8)	success	✅
install-pkg (ubuntu-22.04, notset, 3.10)	success	✅
install-pkg (macOS-12, app, 3.8)	success	✅
install-pkg (macOS-12, app, 3.10)	success	✅
install-pkg (macOS-12, fabric, 3.8)	success	✅
install-pkg (macOS-12, fabric, 3.10)	success	✅
install-pkg (macOS-12, pytorch, 3.8)	success	✅
install-pkg (macOS-12, pytorch, 3.10)	success	✅
install-pkg (macOS-12, lightning, 3.8)	success	✅
install-pkg (macOS-12, lightning, 3.10)	success	✅
install-pkg (macOS-12, notset, 3.8)	success	✅
install-pkg (macOS-12, notset, 3.10)	success	✅
install-pkg (windows-2022, app, 3.8)	success	✅
install-pkg (windows-2022, app, 3.10)	success	✅
install-pkg (windows-2022, fabric, 3.8)	success	✅
install-pkg (windows-2022, fabric, 3.10)	success	✅
install-pkg (windows-2022, pytorch, 3.8)	success	✅
install-pkg (windows-2022, pytorch, 3.10)	success	✅
install-pkg (windows-2022, lightning, 3.8)	success	✅
install-pkg (windows-2022, lightning, 3.10)	success	✅
install-pkg (windows-2022, notset, 3.8)	success	✅
install-pkg (windows-2022, notset, 3.10)	success	✅

These checks are required after the changes to requirements/pytorch/strategies.txt.

🟢 link-check

Check ID	Status
markdown-link-check	success	✅

These checks are required after the changes to src/lightning/pytorch/CHANGELOG.md.

Thank you for your contribution! 💜

Note
This comment is automatically generated and updates for 60 minutes every 180 seconds. If you have any other questions, contact carmocca for help.

.azure/gpu-tests-pytorch.yml

Borda · 2023-02-16T08:55:10Z

pkg is up https://pypi.org/project/lightning-colossalai/

This reverts commit 08359e4.

docs/source-pytorch/advanced/model_parallel/colossalai.rst

awaelchli added 2 commits February 16, 2023 00:22

third party docs

0060424

move

c3d2ad8

awaelchli added docs Documentation related strategy: colossalai (removed) Colossal-AI labels Feb 15, 2023

awaelchli added this to the 2.0 milestone Feb 15, 2023

github-actions bot added ci Continuous Integration pl Generic label for PyTorch Lightning package labels Feb 15, 2023

[pre-commit.ci] auto fixes from pre-commit.com hooks

33a4a45

for more information, see https://pre-commit.ci

awaelchli commented Feb 15, 2023

View reviewed changes

docs/source-pytorch/advanced/model_parallel/model_parallel.rst Outdated Show resolved Hide resolved

awaelchli added 6 commits February 16, 2023 00:41

.git

6e285f7

Merge remote-tracking branch 'origin/docs/colossalai' into docs/colos…

be85e54

…salai

git

8374319

update docs

b20d939

colossal ai intro text

faacb87

workaround

08359e4

awaelchli commented Feb 16, 2023

View reviewed changes

docs/source-pytorch/advanced/model_parallel/colossalai.rst Outdated Show resolved Hide resolved

awaelchli marked this pull request as ready for review February 16, 2023 05:22

awaelchli requested review from edenlightning, lantiga, Borda, carmocca and akihironitta as code owners February 16, 2023 05:22

awaelchli added 2 commits February 16, 2023 06:25

changelog

634bb51

Merge branch 'master' into docs/colossalai

98e5612

awaelchli requested review from williamFalcon and justusschock as code owners February 16, 2023 05:26

awaelchli commented Feb 16, 2023

View reviewed changes

.azure/gpu-tests-pytorch.yml Outdated Show resolved Hide resolved

akihironitta approved these changes Feb 16, 2023

View reviewed changes

awaelchli added 2 commits February 16, 2023 12:55

Revert "workaround"

48f76b6

This reverts commit 08359e4.

update

b567ff5

awaelchli requested a review from tchaton as a code owner February 16, 2023 11:56

awaelchli added 2 commits February 16, 2023 12:59

update

576ff8a

update links to moved document

0922829

carmocca approved these changes Feb 16, 2023

View reviewed changes

docs/source-pytorch/advanced/model_parallel/colossalai.rst Outdated Show resolved Hide resolved

mergify bot added the ready PRs ready to be merged label Feb 16, 2023

awaelchli added 3 commits February 16, 2023 15:10

fix docs build errors

2e6e4d2

avoid change in index.html codeowner review

1cdbc77

clarify mixed precision

631a8b8

Borda approved these changes Feb 16, 2023

View reviewed changes

awaelchli enabled auto-merge (squash) February 16, 2023 14:36

awaelchli added 2 commits February 16, 2023 15:38

fix undefined label error

3d69e2b

weird whitespace fix

a600f8f

awaelchli merged commit ad698f0 into master Feb 16, 2023

awaelchli deleted the docs/colossalai branch February 16, 2023 16:14

awaelchli mentioned this pull request Feb 16, 2023

Trigger colossalai integration test in CI #16789

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update Colossal AI docs and integration #16778

Update Colossal AI docs and integration #16778

Uh oh!

awaelchli commented Feb 15, 2023 •

edited by github-actions bot

Loading

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Feb 16, 2023 •

edited

Loading

Uh oh!

Uh oh!

Borda commented Feb 16, 2023

Uh oh!

Uh oh!

Uh oh!

Update Colossal AI docs and integration #16778

Update Colossal AI docs and integration #16778

Uh oh!

Conversation

awaelchli commented Feb 15, 2023 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Feb 16, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚡ Required checks status: All passing 🟢

Groups summary

Uh oh!

Uh oh!

Borda commented Feb 16, 2023

Uh oh!

Uh oh!

Uh oh!

awaelchli commented Feb 15, 2023 •

edited by github-actions bot

Loading

github-actions bot commented Feb 16, 2023 •

edited

Loading