Software Engineer - High Performance Computing / Large Scale Neural Language Processing / Machine...

Work group:

JSC - Jülich Supercomputing Centre

Area of research:

Scientific / postdoctoral posts

Job description:

Work with Europe’s largest supercomputer. Develop the largest Machine Learning models. Find new applications of ML that pushes science forward. At the Jülich Supercomputing Centre (JSC), we operate one of the most powerful supercomputer infrastructures for scientific and engineering applications in Europe. In the project OpenGPT-X, we will develop a large-scale language model for European languages as a foundation for our partners applications. This project is part of the GAIA-X project, a European initiative aiming at an open, transparent data infrastructure. The models and training code will be published and we will contribute to make the Neural Language Processing market more independent and Open Source. In the Algorithm Tools and Methods Lab (ATML) "Applied Machine Learning" at JSC, we develop new ML applications for science with special focus on HPC systems. We identify exciting data sets, develop interesting research questions, train powerful models, and try to push further what is possible with AI.

Your Job:

As part of the ATML Applied Machine Learning, you will develop scalable High-Performance Computing techniques that allow training large Machine Learning models on the largest supercomputer in Europe. Your most important tasks will be the scalable training of the model in the Open-GPT-X project. Furthermore, you will apply your Machine Learning knowledge to research problems from various domains, such as Earth and Environment, Remote Sensing, Cosmology, or Molecular Modeling. In more details, your work comprises:

• Develop a scalable, efficient training algorithm for a large-scale language model in close collaboration with our project partners


• Identify and implement new application of ML in science and technology


• Support the work of the lab: discuss opportunities of ML applications in science, implement prototypes, and support HPC users; engage in discussion with researchers from various fields


• Engage in national and international ML/DL communities, most importantly helmholtz.ai, the Helmholtz Artificial Intelligence Cooperation Unit


• Present research results at scientific meetings, conferences, and as scientific papers.

Your Profile:

• Excellent Master or PhD (preferred) degree in Computer Science, Mathematics, Physics, or similar fields


• Proven Track Record in AI and applied Machine Learning, preferably with special emphasis on NLP models


• Practical experience with High Performance Computing Systems as well as parallel/distributed programming


• Very good command of written and spoken English and (preferably) fluency in a second European language


• Practical experience with ML/DL workflows and common software libraries


• Your experience should be documented in research papers and Open Source code projects


• Self-motivated personality, curiosity of working in a multi-disciplinary team and environment of scientifically challenging problems

Our Offer:

We work on the very latest issues that impact our society and are offering you the chance to actively help in shaping the change! We support you in your work with:

• Work on frontiers of scientific and technological challenges with access to cutting-edge and unique supercomputing systems including Quantum Computers and ML supercomputers


• Engage in NLP, one of the most exciting and fast-paced disciplines of Machine Learning, and train the largest and most advanced models


• Comprehensive training courses and individual opportunities for personal and professional further development


• Extensive company health management


• Ideal conditions for balancing work and private life, as well as a family-friendly corporate policy


• Full-time position with the option of slightly reduced working hours and 30 days of annual leave


• Targeted services for international employees, e.g. through our International Advisory Service


• A large research campus with green spaces, offering the best possible means for networking with colleagues and pursuing sports alongside work

We offer you an exciting and varied role in an international and interdisciplinary working environment. The position is initially for a fixed term of 2 years, with possible long-term prospects. Salary and social benefits in conformity with the provisions of the Collective Agreement for the Civil Service (TVöD).Please note that at the same time as this position, a vacancy for a Research Scientist Machine Learning position is published.Forschungszentrum Jülich promotes equal opportunities and diversity in its employment relations.We also welcome applications from disabled persons.

This research center is part of the Helmholtz Association of German Research Centers. With more than 42,000 employees and an annual budget of over € 5 billion, the Helmholtz Association is Germany's largest scientific organisation.