Repository navigation
How to install smdistributed? #2258
Description
What did you find confusing? Please describe.
I installed sagemaker with pip install sagemaker --update, and am attempting to use distributed model parallel with pytorch. However, I'm unable to import smdistributed.
The docs https://sagemaker.readthedocs.io/en/stable/api/training/smp_versions/v1.2.0/smd_model_parallel_pytorch.html don't have installation instructions for smdistributed. I was wondering how do I get smdistributed installed? Thank you!
I am also looking at https://docs.amazonaws.cn/en_us/sagemaker/latest/dg/model-parallel-customize-training-script-pt.html which directs me to https://sagemaker.readthedocs.io/en/stable/api/training/smp_versions/v1.2.0/smd_model_parallel_common_api.html#smp.init to initialize the sagemaker distributed environment. But again I'm not sure how to get the smdistributed library.
https://github.com/aws/amazon-sagemaker-examples has some smdistributed examples but doesn't provide any clear installation instructions. environment.yml in that repo seems to indicate all that's needed is sagemaker which I have installed.
Describe how documentation can be improved
Could not find clear installation instructions for smdistributed, would it be possible to add these?
Additional context
Add any other context or screenshots about the documentation request here.
Activity
juliensimon commentedon Apr 1, 2021
Hi,
the easiest way is to either use or start from one of the built-in TensorFlow/PyTorch containers.
You can also build your own, starting from the SageMaker Training Toolkit at https://github.com/aws/sagemaker-training-toolkit.
More details at https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-use-api.html
and https://docs.aws.amazon.com/sagemaker/latest/dg/data-parallel-use-api.html
TEChopra1000 commentedon Apr 6, 2021
Note: SageMaker distributed is not currently supported in the Chinese regions. I'm adding this note because I see that you've pointed to a doc in the China region.
rohan-varma commentedon Apr 7, 2021
I see, I'm actually not sure why I ended up at a
.cnlink. I think google somehow directed me to the.cndomain when I entered in my search query