π‘ Sam Foreman[.me]
-
π» Computational scientist
@ Argonne National Laboratory (ALCF) -
π§ͺ Interested in:
- {AI, HPC} for science
- π scaling large models across thousands of GPUs
π» Computational scientist
@ Argonne National Laboratory (ALCF)
π§ͺ Interested in:
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Minimalistic large language model 3D-parallelism training
Forked from deepspeedai/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2