DeepSpeed source code study
DeepSpeed Architecture(from https://www.youtube.com/watch?v=zqsOEzKZX2Y&t):
There are major two parts: runtime and ops.
DeepSpeed runtime study: http://aheader.org/2021/10/02/deepspeed-runtime-study/
DeepSpeed ops study:
DeepSpeed Architecture(from https://www.youtube.com/watch?v=zqsOEzKZX2Y&t):
There are major two parts: runtime and ops.
DeepSpeed runtime study: http://aheader.org/2021/10/02/deepspeed-runtime-study/
DeepSpeed ops study:
发表评论