12 parallel-and-distributed-computing positions at Oak Ridge National Laboratory in United States
Sort by
Refine Your Search
-
Category
-
Field
-
of the group. Strong knowledge of performance modeling, simulation, and benchmarking of parallel and distributed computing systems and of the workflow systems that run on them. Familiarity with the FAIR data and
-
background in one or more of the following areas: computer architecture, high-performance computing, quantum computing systems, distributed and heterogeneous computing, runtime systems, or performance modeling
-
distributed intelligence across the computing continuum. In this role, you will have the opportunity to lead and contribute to cutting-edge research aimed at transforming scientific data management and
-
. Design and implement distributed and parallel approaches that efficiently leverage large-scale computing resources, including heterogeneous CPU/GPU systems, along with the possibility of working with
-
and cloud computing platforms. Formulating necessary solutions using various parallel computing paradigms and tools, HPC schedulers (such as slurm), Containers and Kubernetes, Python, Bash and other
-
Language Models (LLMs). Distributed Machine Learning: Specialization in data parallelism, model-parallelism, and collective communication strategies in large-scale environments. Proficiency in frameworks
-
. Demonstrated programming ability and knowledge of Python and/or C++. Experience with deep learning frameworks like PyTorch and application on high-performance computing (HPC) environments using distributed data
-
for Science @ Scale: Pretraining, instruction tuning, continued pretraining, Mixture-of-Experts; distributed training/inference (FSDP, DeepSpeed, Megatron-LM, tensor/sequence parallelism); scalable evaluation
-
management of High-Performance Computing (HPC) systems within a classified environment. We are looking for candidates with experience in HPC architecture, cluster management, and parallel computing, with a
-
Requisition Id 16505 Overview: The Computer Science and Mathematics Division at Oak Ridge National Laboratory (ORNL) is seeking an exceptional Postdoctoral Researcher to advance programming systems