[Out of Box Experience]: PreBuilt PyPi Distribution of TransformerEngine - Parity with Nvidia

[functionstackx]

@hliuca Nvidia provides an option to install prebuilt transformer engine binaries through pypi.

For AMD to achieve parity on user experience that wanna use prebuilt binaries with pypi instead docker, amd should provide this option too

pip install transformer_engine[pytorch]

https://pypi.org/project/transformer-engine/

https://github.com/nvidia/TransformerEngine?tab=readme-ov-file#pip

[hliuca]

@wenchenvincent could you please take a look at this? Thank you.

[ipanfilo]

Currently TE releases wheels to install at https://repo.radeon.com.
For instance, you can download rocm/manylinux/rocm-rel-7.0.2/transformer_engine* packages from there and install them or call pip install --no-index --find-links https://repo.radeon.com/rocm/manylinux/rocm-rel-7.0.2/ transformer_engine[pytorch]

[leo-amd]

Spoken with @wenchenvincent. They mentioned there's currently no plans to upload to pypi