Pipeline Operator

Caltech is a world-renowned science and engineering institute that marshals some of the world's brightest minds and most innovative tools to address fundamental scientific questions. We thrive on finding and cultivating talented people who are passionate about what they do. Join us and be a part of the diverse Caltech community.

IPAC, in the Physics, Math, and Astronomy Division at Caltech, provides science operations, user support, data and archive services, and scientific vision to enhance discovery with observatories both in space and on the ground. SPHEREx (http://spherex.caltech.edu/), a NASA Astrophysics Explorer mission, will conduct a spectroscopic, infrared survey of the entire sky starting in 2025. IPAC provides the SPHEREx Science Data Center (SSDC), and we are responsible for the development and operation of the data pipeline and for the archiving and support of the data at the NASA/IRSA Infrared Science Archive.  IPAC is inviting candidates to apply for a full-time position as a data processing Pipeline Operator with the Roman team at IPAC.

Job Summary

As a Pipeline Operator, you will work with the SSDC to help operate, and test the automated data pipeline. During operations, the Pipeline Operator ensures the automated system is running as expected during operations and carries out maintenance activities, working with the scientists and engineers on the team.

Regular tasks

• Manage the operation of automated processes including aliveness checks, suspending and restarting.
• Check the summary of the processing and rerun any failed data sets.
• Aide in testing during development of the pipelines.
• Develop and maintain scripts to assist with the above activities.
• Review and update communication channels and system monitoring websites on a regular basis.
• Communicate regularly with the rest of the pipeline team.

Basic Qualifications

• Bachelor’s degree or equivalent experience in Computer Science, Computer Engineering, Astronomy, Physics, Math or a related technical field.
• Minimum 1 year of experience in building and maintaining batch-oriented workflows with Apache Airflow or other task schedulers, using a Kubernetes cluster, or other distributed computer cluster.
• Experience coding with Python or C++
• Good written and interpersonal communication skills, with an emphasis on the ability to share ideas in a collaborative setting.

Requirement

• Applicants for this position must be a United States (US) person as defined by ITAR regulations - A US person is a citizen of the United States, a lawful permanent resident alien of the US (“Green Card” holder), or individuals granted refugee and Asylee status under US law.

Preferred Qualifications

Beyond these basic qualifications, there are a set of skills and experiences which will add to your ability to contribute to the roles and responsibilities of an IPAC Pipeline Operator. The following might give you a head start here, but even if these do not describe you or your experience, we would still like to hear from you:

• Familiarity with Slack, Jira, or Confluence.
• Familiarity with software configuration management principles and tools (e.g., git/GitHub) 

Required Documents

• Resume.
• Short Cover Letter.
• Names and contact information for 3 references.

For full consideration, apply by August 31, 2024.   The preferred start is November, 2024 and the position will remain open until filled. 

Life at IPAC

People choose to work at IPAC for many reasons, and the casual, employee-centric culture often leads to fulfilling, long-term careers and positive relationships. Caltech’s benefits program offers a quality, competitive benefits package that is affordable for you and the Institute. We also offer a 403(b) defined contribution plan to eligible staff as well as a Voluntary Retirement Savings (TDA) Plan. IPAC staff have access to the Institute’s facilities, including the athletic center, libraries, on-site daycare, professional development and enrichment classes, and Athenaeum club membership.