VOTING SYSTEMS

ASSESSMENT PROJECT

LOS ANGELES COUNTY REGISTRAR-RECORDER/COUNTY CLERK

VOTER-CENTERED SYSTEM DESIGN

24,911,79010,116,705 6,059,795

88 cities

LOS ANGELES

COUNTY

BACKGROUND

Need to replace existing system• InkaVote Plus extended past its lifespan• Antiquated technology

No system available in the market• County is the largest and most complex election jurisdiction• Regulatory environment has inhibited innovation

Vendor designed/owned systems are designed for profitability, not necessarily voter-needs

GOAL

Design a new voter experience that is voter-centered and sensitive to the human experience

ENGAGING STAKEHOLDERS

Future of Voting Systems Symposium

Public opinion research

User testing

VSAP Advisory Committee and VSAP Technical Advisory Committee

Website and publications

FUTURE OF VOTING SYSTEMS SYMPOSIUM

Partner: CalTech/MIT Voting Technology Project

PUBLIC OPINION RESEARCH

Focus GroupsPartner: CalTech/MIT Voting Technology Project, ISA Qualitative Insights, Atkins Research

County-wide SurveysPartner: CalTech/MIT Voting Technology Project

Community DiscussionsPartners: CalTech/MIT Voting Technology Project, The Braille Center, League of Women Voters

Brainstorming WorkshopsPartners: Election Verification Network, ITIF

Online CrowdsourcingPartner: ITIF Accessible Voting Technology Initiative

USER TESTING

• Hundreds of voters with a diverse range of needs have been engaged

• Targeted component testing as well as overall experience testing

Partners: LA County Quality and Productivity CommissionIDEO

USER TESTING

“I think if the voting machine could talk, it would be much easier for me. Right now it’s down to comprehending ballots. When I try to read ballots, it’s not simple enough for my level…” - Voter with low literacy

“I could understand the audio as if I can see! - Voter with visually impairment

Nancy Mahr (Chair) President League of Women Voters LA County Eric Bauman Chair Los Angeles County Democratic Party Theresa Devoy City Clerk City of Norwalk Efrain Escobedo Vice President of Civic and Public Engagement California Community Foundation Kathay Feng Executive Director California Common Cause Carolyn Fowler Election Protection Board Co-Chair Los Angeles County Democratic Party

Maria De la luz Garcia City Clerk City of Long Beach Ron Hasson President Beverly Hills/Hollywood NAACP Rick Hasen Chancellor's Professor of Law and Political Science UC Irvine School of Law Jaclyn Tilly Hill Chair Emeritus Quality and Productivity Commission Los Angeles County Mimi Kennedy Board Chair Progressive Democrats of California

Deanna Kitamura Senior Staff Attorney Asian Americans Advancing Justice LA Terri Lantz Advocacy Coordinator United Cerebral Palsy Ofelia M. Medina Director of the State of Civic Engagement Policy National Association of Latino Elected and Appointed Officials Mark Vafiades Chair Republican Party of Los Angeles County Holly L. Wolcott City Clerk City of Los Angeles Bryce Yokomizo Adjunct Faculty School of Public Administration California State University, Northridge

ADVISORY COMMITTEE

Henry Balta Senior Associate C.I.O

Los Angeles County

Michael Byrne Professor of Psychology and Computer Science

Rice University

Joshua Franklin IT Specialist, Security

nal Institute of Standards and Natio Technology (NIST)

Diane Cordry Golden Policy Coordinator

Association of Assistive Technology Act Programs

Joseph Lorenzo Hall Senior Staff Technologist

The Center for Democracy and Technology

Brian J.Hancock Director of Testing and Certification U.S. Election Assistance Commission

Jared Marcotte Web Developer

Interface and Interaction Designer

Noel Runyan Personal Data Systems

Owner

Richard Sanchez Chief Information Officer

Los Angeles County

Pamela W. Smith President

Verified Voting Foundation

Charles Stewart III Kenan Sahin Distinguished Professor Political Science

Massachusetts Institute of Technology

Whitney Quesenbery Co-Director

Center for Civic Design

David Wagner Professor of Computer Science

University of California Berkeley

TECHNICAL ADVISORY COMMITTEE

WEBSITE AND PUBLICATIONS

Website

Social Media

Meeting Livestreaming

Quarterly Report

Quarterly Newsletter

STAKEHOLDERS ENGAGED

Date Activity Total

March 11-29, 2010 Countywide Voter Survey - Phone 651

March 16-28, 2010 Countywide Voter Survey - Online 500

March 31 - April 2, 2010 RR/CC Staff Focus Groups 64

April 5-6, 2010; April 29 - May 3, 2010 Registered Voter Focus Groups 100

April 29 - June 8, 2010 Pollworker Survey - Online 1,100

May 7-11, 2010 Local Election Officials Focus Groups (City Clerks) 26

July 21, 2010 Community Discussion- Language Groups 9

August 11, 2010 Community Discussion- Voter Integrity Groups 9

September 20, 2010 Community Discussion- Disability Groups 6

January 24- March 28, 2012 Online Open Innovation Challenge 154

January25- February 23, 2012 AVTI Brainstorming Workshops 32

March 30, 2012 Election Verification Network (EVN) Conference Session 24

April 5-6, 2012 RR/CC Staff Brainstorming Workshops 25

January 27-February 1, 2014 Atkins Research Focus Groups 95

February 5, 2015 User Testing Session - General Population 5

February 27, 2015 User Testing Session - Spanish Speakers, Seniors 57

March 3 and 26, 2015 User Testing Session - Visually Impaired 5

April 29, 2015 User Testing Session - Election workers 22

May 26, 2015 User Testing Session - Seniors 27

May 28, 2015 User Testing Session - Veterans with Disabilities 40

May 28, 2015 User Testing Session - Spanish Speakers, Visually Impaired 39

May 30, 2015 User Testing Session - Korean Speakers, young voters 39

May 30, 2015 User Testing Session - General Population 39

November 9-20, 2015 Vote By Mail User Testing 76

November 20, 2015 Vote By Mail Focus Group UCPLA 10

TOTAL 3154

Partnerships

Guiding Principles

KEY TO SUCCESSFUL VOTER ENGAGEMENT

LATEST PROPOSED DESIGN

PROJECT TIMELINE

2009 2011 20162010 2019

Phase I: Public

Opinion Baseline

Research

(Sep 2009 – Jul 2010)

Phase II:

Establishment of

Principles

(Jan 2011 – Dec 2011)

Phase III: System

Design and

Engineering

(Jan 2011 – May 2016)

Phase IV:

Manufacturing and

Certification

(Jun 2016 – Feb 2019)

Objective: Phase I of the project sought to compile an array of baseline data from multiple

stakeholders that included voters, pollworkers, advocates, key

community organizations representing traditionally

underserved voter constituencies, and elections staff.

Objective: Phase IV of the project will result in the manufacturing

and certification of the new voting system and its components.

Objective: Phase III of the project will identify the development

strategy for a new voting system, establish a formal advisory committee with technical

expertise, design a new voting system and develop the

engineering specifications for manufacturing and certification.

Objective: Phase II of the project sought to define fundamental

guiding principles of the project, establish a formalized stakeholder input body for the duration of the

project, and to evaluate and assess the landscape for acquiring a new

voting system.