ECHO Evaluation Manager (Remote)

University of Colorado | CU Anschutz Medical Campus

School of Medicine | Office of the Dean | Peer Mentored Collaborative

Official Title: Business Services Manager

Working Title: ECHO Evaluation Manager

Position #00802517 – Requisition #27440

*This position is expected to be remote*

* Applications are accepted electronically ONLY at www.cu.edu/cu-careers *

The University of Colorado has a requirement for COVID-19 vaccinations and full completion thereof by 9/1/21 or upon start date.  Information regarding this requirement, and exemptions can be found at:

Anschutz: https://www.ucdenver.edu/docs/librariesprovider284/default-document-library/3000-general-admission/3012---covid-19-vaccination-requirement-and-compliance.pdf?sfvrsn=4e9df3ba_2

Denver: https://www.ucdenver.edu/coronavirus

Exemptions vary by campus location/department.

Campus/Unit-Specific Exemptions:

• Anschutz Campus – Exemptions are allowed for medical or religious reasons.
• Denver Campus - Exemptions are allowed for medical, religious, or personal reasons.
• Consolidated/Central Services Administration – Will follow Anschutz policy on exemptions.

The University of Colorado Anschutz Medical Campus seeks individuals with demonstrated commitment to creating an inclusive learning and working environment. We value the ability to engage effectively with students, faculty and staff of diverse backgrounds.

School of Medicine, Office of the Dean, Peer Mentored Collaborative has an opening for a full-time University Staff (unclassified) ECHO Evaluation Manager.

The University of Colorado Anschutz Medical Campus is a world-class medical destination at the forefront of transformative science, medicine, education and patient care. The campus encompasses the University of Colorado health professional schools, more than 60 centers and institutes, and two nationally ranked independent hospitals - UCHealth University of Colorado Hospital  and Children's Hospital Colorado  - that treat more than two million adult and pediatric patients each year. Innovative, interconnected and highly collaborative, the University of Colorado Anschutz Medical Campus delivers life-changing treatments, patient care and professional training and conducts world-renowned research fueled by over $650 million in research grants. For more information, visit www.cuanschutz.edu .

Jobs in this career family provide general business operations of the organization or a combination of operational responsibilities covering multiple career families.  Functions include institutional research, statistical analysis, policy development and review, strategic planning and broad unit business operations such as parking and transportation services, risk management, childcare services, real estate and property management, retail services or job responsibilities that combine fiscal, HR and operational management responsibilities.

Managers are responsible for the day-to-day operation of functional work units, including the development and implementation of processes consistent with college, school or departmental strategies and processes and the supervision of professional and support staff.

The ECHO Evaluation Manager position will be responsible for leading, supporting and managing evaluation team responsible for evaluation for all ECHO Colorado activities. ECHO is an innovative tele-mentoring program designed to create virtual communities of learners by bringing together healthcare providers and subject matter experts using videoconference technology, brief lecture presentations, and case-based learning, fostering an “all learn, all teach” approach.  This position will work collaboratively with the Development and Implementation (D&I) Team to develop, plan, and implement multiple evaluation projects concurrently. This may include the development and validation of new data collection surveys, the use of disparate data collection platforms and varied analytical approaches.  The position will support clinical project leads with interpretation and translation of evaluation and research findings into practice and program settings. This position requires familiarity with range of evaluation methodology and design, competency running basic descriptive and inferential statistics (t-test, ANOVA) and qualitative analysis skills. The successful candidate will work autonomously in order to lead and/or collaboratively contribute to projects as circumstances sometimes change and require ability to work with rapidly changing demands. The position will also be responsible for ensuring timely and high-quality deliverables, including internal and external reports and presentations.

Professional Field

Business, Research and Administration

Supervision Received

This position reports directly to the PMCC Director

Supervision Exercised

This position will supervise staff positions totaling 3.0 FTE and a team of outside consultants.

Examples of Work Performed

• Serve as subject matter expert during project planning meetings to develop appropriate evaluation plan, identify and refine specific metrics, talk through any data collection barriers or limitations
• Work collaboratively with internal project coordinators and external clinical partners to design program-level evaluation plans for ECHO Colorado
• Customize and contextualize ECHO series evaluation services to different clinical topics and stakeholder needs
• Develop weekly team meeting agendas & facilitate team meeting with direction from executive leadership
• Streamline data infrastructure(s) and automate report deliverables where possible
• Develop, implement and monitor data processes to ensure best-practice is being followed throughout the process from project initiation to completion
• Work collaboratively to develop and maintain reporting processes for the ECHO Colorado leadership, funders, and partners
• Lead projects by establishing project work plans, timelines, deliverables, and resources needed to successfully support projects
• Assist in the development of instrument design
• Represent the evaluation team at meetings with internal partners as well as external clinical partners
• Conduct regular stakeholder meetings of key partners related to progress and implementation
• Create and maintain custom queries to scrub, aggregate and visualize data according to unique project specifications
• Align scripting language across projects and platforms to the degree possible to eliminate duplicate work
• Provide feedback for improvement in data infrastructure and departmental SOPs which will allow improvements in how data is extracted, analyzed and visualized
• Running data queries to identify coding issues and data exceptions
• Perform QC of all department outputs including analyses and reports 
• Present findings and recommendations from evaluation studies to advance organizational mission
• Maintain knowledge of best practices related to program evaluation
• Report data analysis findings to leadership to inform business decisions and prioritize information system needs
• Functions as a liaison between the employees, physicians, executive leadership and operations team
• Regularly review literature for best practice and innovative evaluation methods

Conditions of Work

• This position is fully dependent on grant funding which is renewed by the organization on annual basis. At that time the unit will determine if additional funding is available to continue the position, or if the position will be terminated.

This description is a summary only and is describing the general level of work being performed, it is not intended to be all-inclusive. The duties of this position may change from time to time and/or based on business need. We reserve the right to add or delete duties and responsibilities at the discretion of the supervisor and/or hiring authority.

Minimum Qualifications

• Bachelor’s degree in healthcare or related field
• Experience managing people and providing supervision
• Experience with organization/ team strategy, alignment of goals, process development and improvement
• Basic to intermediate skill using statistical software such as SPSS or R and online survey design software such as Qualtrics (preferred) or REDCap
• Substitution: A combination of education and related technical/paraprofessional experience may be substituted for the bachelor’s degree on a year for year basis

The position requires extensive, diverse and progressively responsible experience including direct responsibility for structuring and leading analytical projects, developing data collection instruments, and interpreting and translating evaluation results into presentable findings and recommendations.

Preferred Qualifications

• Master’s degree in healthcare or related field
• 1-3 years complex project management experience
• 5+ years of applied research/evaluation experience
• Experience evaluating education/training programs

Competencies

• Ability to communicate effectively, both in writing and orally
• Ability to establish and maintain effective working relationships with employees at all levels throughout the institution
• Solid written and verbal presentation skills, with a strength at making complex topics, data, and analysis understandable to a variety of audiences using narratives, tables, graphics, and maps
• Ability to understand and relate to the needs of staff and ECHO participants of diverse ethnic, cultural, educational, and socioeconomic backgrounds
• Familiarity with the principles, practices, and procedures of research and evaluation methodologies

Required: Applicants must meet minimum qualifications at the time of hire.

Salary and Benefits

The salary range (or hiring range ) for this position has been established at $72,900 to 92,729.  

The salary of the finalist(s) selected for this role will be set based on a variety of factors, including but not limited to, internal equity, experience, education, specialty and training.

The above salary range (or hiring range ) represents the University’s good faith and reasonable estimate of the range of possible compensation at the time of posting.

This position is not eligible for overtime compensation.

Your total compensation goes beyond the number on your paycheck. The University of Colorado provides generous leave, health plans and retirement contributions that add to your bottom line.

Benefits: https://www.cu.edu/employee-services/benefits

Total Compensation Calculator: http://www.cu.edu/node/153125

Diversity and Equity

The University will provide reasonable accommodations to applicants with disabilities throughout the employment application process. To request an accommodation pursuant to the Americans with Disabilities Act, please contact the Human Resources ADA Coordinator at [email protected] ​.

The University of Colorado Denver | Anschutz Medical Campus is committed to recruiting and supporting a diverse student body, faculty and administrative staff. The university strives to promote a culture of inclusiveness, respect, communication and understanding. We encourage applications from women, ethnic minorities, persons with disabilities, persons within the LGBTQ+ community, and all veterans. The University of Colorado is committed to diversity and equality in education and employment.

The University of Colorado Denver | Anschutz Medical Campus is dedicated to ensuring a safe and secure environment for our faculty, staff, students and visitors. To assist in achieving that goal, we conduct background investigations for all prospective employees.