Senior Data Engineer

Updated: about 1 year ago
Location: Chicago, ILLINOIS
Job Type: FullTime
Deadline: The position may have been removed or expired!

Department
 

F&A ITS - Business Intelligence Solutions


About the Department
 

IT Services collaborates with campus partners to support the mission of the University of Chicago through the consistent delivery of high-quality solutions and services. • We provide secure, stable, and reliable infrastructure and applications to support the mission of the University. • We support and enable faculty research and teaching with the effective use of technology. • We simplify the technology experience for faculty, students, alumni, and staff, and we ensure technology is mobile-friendly and accessible. • We identify, manage, and mitigate the technology risks of the University.


Job Summary
 

This individual will be the technical lead on projects to design, develop, and QA Data Warehouse (DW) and extract/transform/load (ETL) environments, and other database environments to enable analytics. Following the prescribed project and development methodology under the direction of a Project Manager, the Senior Data Engineer will work closely with the Lead Architect, BI Lead, DW developers, source application developers, and subject matter experts (SMEs). The Senior Data Engineer will support, maintain, and enhance these environments to achieve a cross-functional, integrated reporting and analysis environment for University users.

Responsibilities

  • Works closely with business analysts and subject matter experts to understand data analysis requirements, data definitions, and to develop data mappings, data rules, and data transformations for reporting related to a particular data warehouse and/or analytic subject area.
  • Finalizes the conceptual data models developed by the BI Lead, most often a dimensional model with facts and dimensions. Documents and communicates model design to project team.
  • Leads development of logical data models.  Documents, communicates, and maintains model design for the project team.
  • Leads design and implementation of physical databases including index definitions, partitioning, parallelism, tuning, and space management. 
  • Utilizes database design and documentation tools to document, analyze, and communicate database information.
  • Designs data warehouse security.
  • Implements tests and QA strategies and prepares for rollout, including assuring data validation and integrity.
  • Coordinates development resources to ensure that project timelines are met.
  • Leads the design of ETL processing modules based on transformation rules, mapping rules, processing requirements and database model.
  • Leads the design of ETL auditing steps to ensure data integrity and completeness of the ETL process.
  • Leads the design of ETL process flow including module dependencies and parallel processing opportunities.
  • Provides documentation for and works with job scheduling team to automate ETL processing.
  • Leads the design of programming specifications for each ETL component.
  • Leads the design of testing plans for each phase of the development process. Plans must ensure accuracy and quality of program code as well as thorough data validation procedures.
  • Develops efficient code that meets analysis and design criteria.
  • Coordinates ETL development resources to ensure that project timelines are met.
  • Provides break-fix support and communicates outages as defined by IT Services standards.
  • Troubleshoots and tunes data warehouse and analytic systems.
  • Coordinates testing of software patches and upgrades.
  • Works closely with BIS colleagues to implement data warehouse best practices, supporting integration of information from different subject areas.
  • Promulgates data warehouse, ETL and related development standards, processes, and best practices throughout BIS.
  • Participates in the selection of data warehouse, ETL and related enabling tools, including software and consulting.
  • Deep expertise in data warehouse, ETL and analytic systems best practices and emerging trends is imperative.
  • Works with users to ensure deliverables are meeting or exceeding expectations. Provides support and communicates issues to users as defined by IT standards.
  • Plans, tests and guides roll-out of patches and upgrades to the BI and analytic software. Solves problems in the development and interpretation of BI and analytics system standards and procedures.
  • Performs other related work as needed.


Minimum Qualifications
 

Education:

Minimum requirements include a college or university degree in related field.

---
Work Experience:

Minimum requirements include knowledge and skills developed through 5-7 years of work experience in a related job discipline.

---
Certifications:

---

Preferred Qualifications

Education:

  • Bachelor's degree.
  • Advanced study or professional certifications in database, data management, DW, or ETL disciplines.

Experience:

  • Four years experience designing and building ETL using ODI.
  • Four years experience designing and building data warehouse systems using Oracle and VPD.
  • Seven years of database and application development experience with a formal software development life cycle.
  • Three years Hadoop experience with Cloudera Apache Hadoop Ecosystem (Nifi, Zeppelin, Oozie, Spark, Impala, Kafka, et al).
  • A minimum of five years of data warehouse development experience including expert knowledge of data warehousing methodologies (e.g. Kimball).
  • A minimum of four years of experience designing and building dimensional data warehouses with Oracle db, Oracle Stored Procedures and Packages.
  • A minimum of four years designing and developing ETL processes for data warehouse implementations using Oracle OWB or equivalent ETL tools.
  • Experience as lead data warehouse/ETL designer on two successful enterprise data warehouse initiatives, using both formal software lifecycle development and project management.
  • Two years experience working within the ITIL framework including incident, service, problem, and change management processes and procedures.

Technical Skills or Knowledge:

  • Expertise with data query, analysis, reporting techniques, and OLAP.
  • Expertise in database design and tools (e.g. Power Designer or Erwin).            
  • Expertise to develop and administer UNIX-based relational database architectures ( ODBC, JDBC, Perl DBI, shell scripting, PL/SQL, SQL Developer, SQL Plus, SQL Loader, TOAD, Java).
  • Superior ETL design and development skills including maps, process flows, auditing, and scheduling using vendor tools (OWB, ODI, Data Stage, or Informatica).
  • Expertise in SQL coding techniques, performance monitoring and tuning.
  • Work with Unix Server, and Windows Workstation and Server environments.
  • Microsoft Office application suite, especially Excel.
  • Programming environments, languages, and systems built using (Java, Python, R).
  • Experience with AI/ML and predictive analytic algorithms.
  • Knowledge of reporting and analytic systems based on current-generation ERP systems.
  • Familiarity with Business Objects, Tableau or OBIA/OBIEE.
  • Experience with Oracle Cloud Financials.
  • Familiarity with higher ed administrative systems and data.

Preferred Competencies

  • Excellent analytic skills to quickly synthesize technical, functional, and user inputs, and manage problem-solving to issue resolution.
  • Expert skills in data profiling, source-target mapping, implementation of transformations and business rules.
  • Joint design sessions, documenting the results using business process design tools.
  • Strong oral and written and oral communication skills, including to develop standards and procedures, and present technical concepts to non-technical audiences.
  • Commitment to working and sharing expertise in a collaborative team environment.
  • Strong sense of accountability for completing work within defined scope and timeline, with ability to multi-task effectively.
  • Very high attention to detail and accuracy.      

Working Conditions

  • Standard office environment.
  • On call responsibilities.

Application Documents

  • Resume/CV (required)
  • Cover Letter (required)


When applying, the document(s) MUST  be uploaded via the My Experience page, in the section titled Application Documents of the application.



Job Family
 

Information Technology


Role Impact
 

Individual Contributor


FLSA Status
 

Exempt


Pay Frequency
 

Monthly


Scheduled Weekly Hours
 

37.5


Benefits Eligible
 

Yes


Drug Test Required
 

No


Health Screen Required
 

No


Motor Vehicle Record Inquiry Required
 

No


Posting Statement
 

Employees must comply with the University’s COVID-19 vaccination requirements. More information about the requirements can be found on the University of Chicago Vaccination GoForward .
The University of Chicago is an Affirmative Action/ Equal Opportunity/Disabled/Veterans Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national or ethnic origin, age, status as an individual with a disability, protected veteran status, genetic information, or other protected classes under the law. For additional information please see the University's Notice of Nondiscrimination.

 

Staff Job seekers in need of a reasonable accommodation to complete the application process should call 773-702-5800 or submit a request via Applicant Inquiry Form.

 

We seek a diverse pool of applicants who wish to join an academic community that places the highest value on rigorous inquiry and encourages a diversity of perspectives, experiences, groups of individuals, and ideas to inform and stimulate intellectual challenge, engagement, and exchange.

 

All offers of employment are contingent upon a background check that includes a review of conviction history.  A conviction does not automatically preclude University employment.  Rather, the University considers conviction information on a case-by-case basis and assesses the nature of the offense, the circumstances surrounding it, the proximity in time of the conviction, and its relevance to the position.

 

The University of Chicago's Annual Security & Fire Safety Report (Report) provides information about University offices and programs that provide safety support, crime and fire statistics, emergency response and communications plans, and other policies and information. The Report can be accessed online at: http://securityreport.uchicago.edu . Paper copies of the Report are available, upon request, from the University of Chicago Police Department, 850 E. 61st Street, Chicago, IL 60637.



Similar Positions