Search

Job

Metrics & Evaluation Manager

Posted by
Democracy Works
|
Brooklyn, NY
New
|
Published 14 days ago

Organizational overview

At Democracy Works, we believe voting should fit the way we live. To that end, we build technology for both voters and election administrators that increases voter access and participation.

  • TurboVote is a tool designed to help voters register, request their ballot, and make their voice heard in every election, from local to national. We’ve connected over ten million Americans with TurboVote by building the largest college, nonprofit, and corporate voter engagement coalition in the country, including more than 300 campuses, nonprofits - like Headcount, Color of Change, and the Hispanic Federation--and companies like Starbucks, Univision, Facebook, Google, and Snap. 
  • As the only comprehensive official election dataset, the Voting Information Project (VIP) helps Americans find their polling site and available ballot dropbox locations where they look for it most: online. Across Google products alone, VIP data was viewed nearly 500 million times in 2020. 
  • Released in 2020, How To Vote breaks down all the options each state offers for voting, their voter registration rules, as well as unique circumstances like voting overseas and voting rights restoration for the formerly incarcerated. Across Google products alone, our How to Vote guides were viewed over 2 billion times. 
  • Our tool Ballot Scout brings transparency and accountability to the vote-by-mail process by allowing elections administrators and voters to track every ballot with the same ease as a package. Ballot Scout helps election administrators track absentee ballots through the mail, providing transparency in the vote-by-mail process and making it easier to follow up when things go awry.
  • Co-founded by Democracy Works and the CAA Foundation, Civic Alliance is a nonpartisan group of businesses working together to build a future where everyone participates in shaping our country. In 2020, membership grew to 1,030 companies with an employee reach of 5,163,938.

As the Manager of Metrics & Evaluation, you will instill confidence that Democracy Works’ day-to-day work is advancing our mission, helping us to go from “thinking so” to “knowing so.” You will be responsible for defining priorities and processes that properly evaluate the effectiveness of our programs, identifying new opportunities to evaluate our programs, democratizing access to our own data so teams can make better informed decisions, and helping teams automate data processing and formatting. 

Location: Brooklyn, NY or remote within the US

Target Start Date: October 19, 2021

Salary Range: $73,800 - $90,000. Offers will vary based on experience and location-based cost-of-living calculations.

Benefits: Vision, dental, & medical insurance; 403(b) retirement savings plan; generous vacation policy; parental leave; long-term disability; employee assistance program

Level: Mid 

Supervisory role: No

You will —

  • Holistically evaluate the quality and effectiveness of our products, efforts to meet our goals, and various data processes (data generation and storage, metrics calculation) across the entire organization
  • Carry out evaluation directly by matching our TurboVote data to known sources of truth (e.g., state voter files) as well as comparing our data more broadly to publicly available sources of trusted information (e.g., Census & ACS results) 
  • Employ data analysis techniques to assess the impact of our tools and programs from a racial justice perspective, as well as a general diversity, equity, and inclusion perspective
  • Identify opportunities to improve our products, goal definition and measurement, and data processes (data generation and storage, metrics calculation) using better-aligned metrics, experimentation, and data science techniques
  • Own relationships that support program evaluation, such as with data vendors and research partners
  • Democratize access to our data by centralizing, cleaning, and connecting the data (where necessary) and then building dashboards and reports so insights can be discovered and shared
  • Automate manual processes in order to make the most up-to-date data available and enable teams to work more efficiently
  • Define and steward our vision of using data in new ways to make better informed decisions
  • ​​Engage in conversations about anti-oppression and racial justice in our work

You are —

  • Able to approach constraints and trade-offs as puzzles to solve rather than obstacles to success
  • Detail-oriented, understanding nuances in data and finding inefficiencies in our processes
  • A communicator who takes pride in helping others understand complex concepts and is comfortable translating between jargon and vernacular
  • Collaborative, able to consider inputs from different subject areas and engage with colleagues across the organization
  • Independently motivated, capable of managing your own projects and seeing them through
  • Curious, a learner who enjoys diving into the details of new subjects and considering how they should inform your work
  • Organized, able to balance requests for information and details about projects while simultaneously having an eye on long-term vision
  • Ambitious yet practical, balancing the desire to improve our products with the reality that perfection should not be the enemy of good
  • Well-versed in issues of racial justice, or beginning to learn more in earnest

You have experience —

  • Manipulating and analyzing data with at least one of SQL, Python, and/or R programming languages; you are proficient in reading in data from a CSV, checking for errors, pivoting data between “tall” and “wide” formats, and calculating summary statistics using packages like pandas, data.table, or dplyr
  • Experience with optimizing and using Google Analytics, or similar tools to measure effectiveness of digital engagement
  • Organizing large, nuanced datasets that relate to each other in complicated ways and contain numerous quality issues (e.g., non-standard data entry, data collection rules changing over time, etc.)
  • Creating and sharing data visualizations using tools like ggplot2, matplotlib, seaborn, or Tableau
  • Defining program metrics and evaluation methods alongside subject matter experts, not just carrying out predefined evaluation work
  • Tackling new situations that don’t have a clear solution, or even a well-defined problem, and figuring out how to best approach them
  • Documenting processes and code for audiences who need a high-level summary as well as those who want to dive into the details
  • Sharing analytical results and strategies with a variety of audiences, including organizational and/or department leaders 
  • Performing statistical evaluations on the results of experiments and on different groups of data as well as using basic regression and classification techniques.
  • The following skills are desirable, but not strictly necessary for this role: version control; unit testing; data engineering experience; designing and fielding experiments or surveys using survey software (e.g., Survey Monkey, Qualtrics); creating visualizations with D3 and/or HTML and CSS; building reports and dashboards that can be updated as new data becomes available using tools like RMarkdown, Shiny, or Dash; using time series analysis or machine learning techniques; using the Census API

Physical demands

This position requires regular, daily use of a computer (including use of G Suite and Slack)  to conduct work and communicate with colleagues. For those working out of our Brooklyn office, the F train stops closest to our office, but exiting the station requires the use of four flights of stairs. Our office has an elevator available at street level. Streets and buildings nearby are currently under construction, which can disrupt sidewalks and result in varying levels of construction noise audible from the office. Our offices share a set of bathrooms with other offices on our floor, and there are no gender neutral bathrooms in the building at this time. 

Social expectations

This role will demand regular meetings and check ins with colleagues across teams, and with external stakeholders like vendors, etc.

Time and travel expectations

DWs regular operating hours are 10 a.m. - 6 p.m. Eastern Time, Monday to Friday. Two times per year, all full-time staff members participate in a five day retreat in our Brooklyn offices. All Staff is held each year in May and November, when we are able to safely do so.  

Organizational overview

At Democracy Works, we believe voting should fit the way we live. To that end, we build technology for both voters and election administrators that increases voter access and participation.

Details at a Glance

  • Time Commitment
    Full Time Schedule
  • Start Date
    October 19, 2021

Salary

USD 73,800 - USD 90,000Offers will vary based on experience and location-based cost-of-living calculations.

Benefits

Benefits: Vision, dental, & medical insurance; 403(b) retirement savings plan; generous vacation policy; parental leave; long-term disability; employee assistance program

Benefits: Vision, dental, & medical insurance; 403(b) retirement savings plan; generous vacation policy; parental leave; long-term disability; employee assistance program

Location

Remote
Work may be performed anywhere in United States
Associated Location
20 Jay St., Brooklyn, NY 11201, United States
Suite 824

How to Apply

Application Instructions

To apply, please attach a resume and respond to the following questions (instead of a cover letter) using the website application link.

In your responses, please include only the following information:

  • How did you find this job listing?
  • In one sentence, what makes you interested in Democracy Works? 
  • In one sentence, what makes you interested in this role?
  • Would you be available to start by Oct 19, 2021?
  • Are you willing to work at a non-partisan organization?
  • Do you have experience engaging with issues of racial justice in your work? 
  • Do you have experience working with R, SQL, and/or Python?

As part of our application, you’ll see an optional form used to collect EEOC demographic information. The data collected in this form is useful in our EEOC reporting and in our assessment of our recruitment practices. However, please keep in mind that the standardized EEOC language used in this form does not reflect the values of Democracy Works--for example, we don’t view gender as binary. We also encourage all applicants to state their pronouns when applying for any job opening at Democracy Works. 

Democracy Works is committed to diversity and inclusion in everything we do and aspires to have a team that's representative of the voters we serve. When hiring, we practice proactive outreach to top talent that’s underrepresented in our sector. We conduct an anonymized skills evaluation, to reduce implicit bias and resume-dependency in our process. We're a woman- and gay-founded nonprofit, and promote an inclusive culture that stands against racism, sexism, homophobia, and ableism (to name a few). To be explicit, we strongly encourage applicants of all races, ethnicities, political party associations, religions (or lack thereof), national origins, sexual orientations, genders, sexes, ages, abilities, and branches of military service. 

Feel free to contact work@democracy.works if you have any questions about our commitment to inclusion or about general hiring practices, or if you need an accommodation for a medical condition during the hiring process. Democracy Works posts all current career opportunities at democracy.works/careers

Application Instructions

To apply, please attach a resume and respond to the following questions (instead of a cover letter) using the website application link.

In your responses…

Join Idealist

Sign up today to save your favorite jobs and get email alerts when new ones are posted.