Director of Evaluation and Learning

Job Type

Full Time


Details: Compensation is commensurate with education and experience.




568 Valley Way
United States


Position Title: Director of Evaluation and Learning

Reports To: Chief Operating Officer                        

Status: Exempt, Full Time with benefits


Location: Based primarily in Santa Clara County (Milpitas HQ), with an occasional presence in Alameda and San Mateo Counties; Remote work hours available


Director of Evaluation and Learning – Position Summary

The Director of Evaluation and Learning is a strategic, collaborative and results-oriented leader with strong research and evaluation skills applicable to informing programmatic impact, quality assurance, and service implementation in a non-profit setting. They serve on the senior leadership team and collaborate closely with executive and senior leadership to advance organizational learning, monitor and measure organizational performance, and articulate the organization’s impact. They oversee the Evaluation and Learning Department to ensure it is responsive to programmatic and agency communications needs, while building and maintaining a data-informed learning culture for the organization.


Specifically, the Director of Evaluation and Learning is responsible for leading FLY’s efforts and progress on its strategic evidence-building agenda, which has as its core purpose two fundamental aims: 1) to provide useful and actionable insights regarding programmatic effectiveness, in collaboration with Program Leadership and for the purpose of continually informing FLY’s ongoing performance management processes; and 2) to inform our understanding of what elements of our program models are critical for scaling up our work to have a greater impact both on the youth we serve and the public systems in which they are involved. The Director of Evaluation and Learning provides strategic thought leadership and evidence-based guidance to both internal and external leaders, including identifying and working with key external partners (e.g., academic institutions, public agencies, consultants). Success in this role will require consistent cross-organizational collaboration and making recommendations that can inform data-driven improvement to optimally achieve impact at the individual youth, community, and systems levels.


Primary Responsibilities

·      Advancing Organizational Learning

o  Oversee implementation and timely progress on FLY’s Learning Agenda and Strategic Evidence-Building Objectives.

o  Collaborate with the COO and programs leadership to ensure strategic alignment of FLY’s programming across multiple jurisdictions

o  Manage key external partnerships to increase organizational capacity to evaluate impact and advance Learning Agenda.

o  Support COO in managing FLY’s Board’s Learning and Impact Committee, and the full Board’s understanding of FLY’s impact and learning objectives.

o  Translate crucial evaluation findings into recommendations that, in collaboration with program leaders, will inform and support the refinement of programs and inform key resource allocation and investment decisions.

o  Collaborate with Director of Programs and Innovation to facilitate Theory of Change implementation meetings, set agendas, and strategically implement change within programs in order to achieve goals and outcomes

o  Promote a data-driven culture of excellence and accountability through the creation of systems for using data to provide ongoing feedback to staff for the improvement of program practices and organizational learning

·      Managing Department Operations

o  Serve as the leader for and manage the operations of the Evaluation and Learning Department

o  Supervise the Evaluation and Learning Manager and oversee all personnel (including interns) to ensure individuals and the department as a whole advances towards its annual deliverables

o  Lead the design, utilization, and maintenance of FLY’s internal tracking system, Efforts to Outcomes (ETO), which supports the data and information needs of all FLY programs, the Board of Directors, funders, partnering agencies, and the entire FLY organization

o  Assess FLY’s data system needs, make recommendations for changes or enhancements, and works with vendors to ensure FLY’s data system needs are successfully met.

o  Oversee the implementation of new projects as it relates to outcome and performance management, data collection methods, and reporting

·      Monitoring Organizational Performance

o  Generate weekly, monthly, and quarterly performance management reports for all program staff, managers, and agency directors to ensure programmatic health and grant execution

o  Generate and present quarterly organizational dashboards to the Board of Directors and senior leadership staff

o  Design custom queries, Excel reports, and analysis tools to meet all program management and grant reporting needs

o  Work in partnership with Program Leadership to drive accountability and align FLY’s vision and Theory of Change with staff and program performance

o  Oversee the alignment of ETO usage and data collection methods with Theory of Change strategies, key indicators of success, and agency outcomes.

o  Collaborate with Development and Program Leadership to ensure the strategic alignment of potential grant applications/funding opportunities with FLY’s current program practices and expected impact by providing outcome data and strategic recommendations as needed

o  Collaborate with the Director of Talent on annual staff performance reviews to ensure compliance on data specific indicators as well as programmatic and individual deliverables.

Other duties as needed and assigned.


Qualification and Competency Requirements

Positional Competencies – required for Director of Evaluation and Learning

  • PROGRAM EVALUATION/ APPLIED RESEARCH EXPERIENCE – Training and expertise in quantitative and/or qualitative methods and evaluation design, ideally with a high level of comfort with mixed-methods approaches. Experience addressing wide-ranging evaluation needs, including rigorous impact and process evaluations; formative and summative evaluations of program, advocacy, and systems change initiatives; strategy reviews; and portfolio-level assessments. Experience designing and facilitating participatory learning activities with funders and practitioners highly desired.
  • DATA EXPERIENCE – Experience working with responsibilities for ensuring the collection, reporting, and use of data for continuous improvement. Experience with Social Solutions’ Efforts to Outcomes, or other case management information systems such as Salesforce highly preferred.
  • STRATEGY DEVELOPMENT AND IMPLEMENTATION – The ability to articulate FLY’s strategy and a willingness to take risks. Politically informed and savvy to analyze opportunities when they arise and to establish, nurture and maintain external relationships that advance our strategic priorities.
  • ACADEMIC & PROFESSIONAL EXPERIENCE – Master’s degree in public policy, sociology, or a related discipline is preferred; Bachelor’s degree in a related field is required, with a minimum of five years of professional experience in justice-related public service, specifically leading evaluation and learning efforts for a non-profit organization.

Managerial Competencies

  • TEAM LEADERSHIP - Invests in staff using both collaboration and guidance; models desired behaviors; builds on strengths and facilitates growth in areas of weakness; seeks input, assesses risks and makes decisions; takes a creative approach to challenges; creates and communicates vision and then empowers team to carry out that vision.
  • PERFORMANCE MANAGEMENT - Sets clear goals with staff and uses data to evaluate progress towards goals; facilitates other people’s realization of their maximum potential; proactively addresses performance issues by diagnosing problems, developing solutions and monitoring progress; celebrates accomplishments.
  • OPERATIONS MANAGEMENT - Develops and implements operational systems that support the organizational mission; regularly evaluates systems for effectiveness; anticipates challenges and responds appropriately to unforeseen problems; demonstrates good instincts regarding long-term impact and implications of action; makes effective decisions and achieves results in the midst of change.


About Fresh Lifelines for Youth (FLY)


FLY is a San Francisco Bay Area-based award-winning non-profit organization dedicated to disrupting the cycle of violence and crime and dismantling the prison pipeline. Our mission is to prevent juvenile crime and incarceration through legal education, leadership training, and one-on-one mentoringAt FLY we believe ALL our children deserve a chance to become more than their past mistakes.


FLY envisions a country where all kids grow up valued and supported, and the pipeline to prison is replaced with meaningful opportunities for kids to live healthy, free, and productive lives that make stronger, safer, and more vibrant communities for us all. By 2028, through partnering with kids, communities, and systems, FLY will help dismantle California’s pipeline to prison, equip 25,000 juvenile-justice and at-risk youth to transform their lives, and strengthen services for marginalized youth in California and beyond. 


FLY’s Theory of Change is: Poverty, racism, immigration discrimination, and other forms of marginalization put youth at greater risk of violence and incarceration. FLY’s program interventions, combined with extensive community and systems collaboration, disrupt the pipeline to prison and put kids on the path to a healthy, free, and productive life. Through this work, FLY has a positive impact on our youth, the communities we serve, and the systems in which we operate.


At FLY, we embrace a diversity of identities, beliefs, thoughts, and experiences. We commit to creating a strong organizational culture of equity and inclusion in order to better serve our youth and our communities. We also commit to identifying the root causes of inequity in the education and juvenile justice systems and to helping rebuild those systems to be more effective, humane, and just.


We strongly encourage women; people of color; individuals who identify as part of the lesbian, gay, bisexual, transgender, and/or queer communities; individuals with experience in the juvenile justice or criminal justice systems; and individuals who are differently abled to apply.

Professional Level

None specified

Minimum Education Required

No requirement

How To Apply