2 parallel-and-distributed-computing-phd uni jobs at Oak Ridge National Laboratory

Group Leader - Workflow and Ecosystems Services

Oak Ridge National Laboratory | Oak Ridge, Tennessee | United States | about 22 hours ago

of the group. Strong knowledge of performance modeling, simulation, and benchmarking of parallel and distributed computing systems and of the workflow systems that run on them. Familiarity with the FAIR data and

Senior Research Scientist, HPC and AI

Oak Ridge National Laboratory | Oak Ridge, Tennessee | United States | 3 days ago

for Science @ Scale: Pretraining, instruction tuning, continued pretraining, Mixture-of-Experts; distributed training/inference (FSDP, DeepSpeed, Megatron-LM, tensor/sequence parallelism); scalable evaluation