Job Description

Position Summary

The focus areas of responsibility of the Data and Evaluation Manager are to: 1) lead the design of rigorous mixed methods program and agency evaluations (integrating qualitative and quantitative data); 2) design program evaluation tools that measure program compliance and quality; 3) monitor programs’ quality and compliance; 4) oversee reporting of administrative, compliance, and quality data; 4) design, stakeholder surveys; 5) develop and communicate recommendations to OCF leadership and other stakeholders regarding improving program quality and compliance; and 6) lead a team of Data Analyst and Evaluation Associates.

Essential Functions

1. Lead the design and implementation of research and evaluation projects that advance program and system performance improvements. This includes using and developing compliance and quality tools to monitor provider progress and alignment to program scope.
2. Work with service providers to develop corrective action plans and plans of improvement when necessary and monitor plans for improvement.
3. Oversee data from key system sources to produce short and long-term outcome and process analyses. Key data sources include but are not limited to case file reviews, program narratives, program observations, surveys, and administrative data on enrollment, attendance, invoicing, and activities.
4. Generate graphs, tables, and other data visuals.
5. Lead the design and analysis of survey questions. Administer surveys to various population groups receiving OCF services.
6. Lead development of qualitative data collection tools and processes for OCF programs, such as case file review tools, observation protocols, surveys, interviews, and focus groups.
7. Organize and lead convenings of OCF and service provider leadership to gather feedback on evaluation initiatives.
8. Work collaboratively with PMT team members to ensure quality implementation of performance management activities and processes.
9. Work collaboratively with PMT team members to oversee the development and management of administrative data management systems, including consulting on system improvements and supporting reporting directly from databases.
10. Write and present project reports, briefs, and/or presentations for system leaders and stakeholders using clear, concise language.
11. Perform related research, evaluation, and supervision duties as assigned.
12. Lead and supervise a team of Data Analysts and Evaluation Associates.

** Qualitative:**

• Ability to lead evaluation and monitoring tool development, including conducting literature reviews for existing tools and using stakeholder input to update existing tools

• Prior experience conducting interviews, focus groups, and observations

• Prior experience analyzing qualitative data, including coding interviews, focus groups, and observations and conducting document reviews

** Quantitative:**

• Prior experience using statistical and survey software such as R, STATA, or Python

• Experience using data collection tools such as Cognito, Qualtrics, or other survey systems.

• Knowledge of basic statistics including descriptive, exploratory, and inferential statistics.

• Prior experience creating basic data visualizations such as charts and tables.

** General:**

• Strong project management abilities, including at least 2 years of project management experience

• Advanced communication skills, including relationship building, managing and leading meetings, and collaborating with non-technical audiences

• Experience supervising staff

• Demonstrated ability to monitor and evaluate programs

• Proven strong research, analysis, and writing skills

• Clear and concise communication of ideas, program scopes, and findings - orally and in writing

• Ability to problem solve and identify several courses of action to make informed decisions about project development and implementation

• Ability to maintain strong working relationships with coworkers, OCF leadership, and service providers

• Ability to work on multiple projects at once while still meeting project deadlines

• Ability to quickly pivot to emergent tasks and project needs

• Knowledge of Microsoft Office Suite, including data analysis tools like Excel and/or Open Source tools

Qualifications

• Master’s degree in social policy, Government Administration, and/or other relevant Social Science preferred
• At least 5 years of data analytics, research and evaluation design, and/or other related experience
• At least 2 years of project management experience

Additional Information

TO APPLY: Interested candidates must submit a cover letter and resume.

Salary Range: $80,000 - $97,000

Discover the Perks of Being a City of Philadelphia Employee:

• Transportation : City employees get unlimited FREE public transportation all year long through SEPTA’s Key Advantage program. Employees can ride on SEPTA buses, subways, trolleys, and regional rail for their daily commute and more.
• Parental Benefits: The City offers its employees 8 weeks of paid parental leave.
• We offer Comprehensive health coverage for employees and their eligible dependents.
• Our wellness program offers eligibility into the discounted medical plan
• Employees receive paid vacation, sick leave, and holidays
• Generous retirement savings options are available
• Pay off your student loans faster - As a qualifying employer, City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program. Join the ranks of hundreds of employees who have already benefited from this program and achieved student loan forgiveness.
• Unlock Tuition Discounts and Scholarships - The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area, ensuring that our employees have access to a wide range of tuition discounts and scholarships. Experience savings of 10% to 40% on your educational expenses, extending not only to City employees but in some cases, spouse and dependents too!

Join the City of Philadelphia team today and seize these incredible benefits designed to enhance your financial well-being and personal growth!

_ *The successful candidate must be a city of Philadelphia resident within six months of hire_

Effective May 22, 2023, vaccinations are no longer required for new employees that work in non-medical, non-emergency or patient facing positions with the City of Philadelphia. As a result, only employees in positions providing services that are patient-facing medical care (ex: Nurses, doctors, emergency medical personnel), must be fully vaccinated.

The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at 215-686-4670 or send an email to faqpchr@phila.gov.

For more information, go to: Human Relations Website: http://www.phila.gov/humanrelations/Pages/default.aspx