Open Development Analytics, a step beyond in project transparency

  • View
    101

  • Download
    0

Embed Size (px)

Text of Open Development Analytics, a step beyond in project transparency

  • Open Development AnalyticsA Step Towards More Project Transparency

    (Reduced version)

    Jesus M. Gonzalez-Barahona

    jgb@bitergia.com @jgbarah http://speakerdeck.com/jgbarahBitergia / LibreSoft (URJC)

    Open Source SummitParis (France), November 16th 2016

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 1 / 54

    http://speakerdeck.com/jgbarah

  • Open

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 2 / 54

  • Software development

    http://xkcd.com/844/

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 3 / 54

    http://xkcd.com/844/

  • Analytics

    https://en.wikipedia.org/wiki/Charles_Joseph_Minard

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 4 / 54

    https://en.wikipedia.org/wiki/Charles_Joseph_Minard

  • Open Development Analytics

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 5 / 54

  • Structure of the presentation

    1 A bit of context

    2 Transparency and governance

    3 Open development analytics

    4 How are changes being reviewed?

    5 Dependency

    6 Dealing with issues?

    7 Diversity

    8 The end

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 6 / 54

  • A bit of context

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 7 / 54

  • Me and my two hats

    Uni Rey Juan Carlos:

    LibreSoft research team

    Understanding free, open source software

    Data analytics approach

    Bitergia:

    From research to the real world

    Understanding software development

    Data analytics approach

    http://gsyc.es/~jgb

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 8 / 54

    http://gsyc.es/~jgb

  • The company

    The software development analytics company

    dashboards

    reports

    consultancy

    ...

    http://bitergia.comJesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 9 / 54

    http://bitergia.com

  • Transparency and governance

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 10 / 54

  • Who drives open software developoment?

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 11 / 54

  • Who drives open software development

    A community

    Persons (and organizations) with

    common goals

    different interests

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 12 / 54

  • Working together

    Self-awareness

    Governance

    Transparency

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 13 / 54

  • Self-awareness

    Open development communitiesneed to be self-aware

    data is the source for awareness...when it can be used for sensing

    The same appliesto any open organization

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 14 / 54

  • Governance

    Establishment of policies, and continuousmonitoring of their proper implementation, by themembers of the governing body of anorganization. It includes the mechanisms requiredto balance the powers of the members (with theassociated accountability), and their primary dutyof enhancing the prosperity and viability of theorganization.

    http://businessdictionary.com

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 15 / 54

    http://businessdictionary.com

  • Governance

    Establishment of policies, and continuousmonitoring of their proper implementation, bythe members of the governing body of anorganization. It includes the mechanisms requiredto balance the powers of the members (with theassociated accountability), and their primaryduty of enhancing the prosperity and viability ofthe organization.

    http://businessdictionary.com

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 16 / 54

    http://businessdictionary.com

  • Transparency

    It comes in two flavors

    Transparency to the community(fairness)

    Transparency to third parties(trust)

    Which for open organizations are kind of the same

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 17 / 54

  • Transparency

    Example of rationale (OpenStack):

    OpenStack favors disclosure and transparency topromote sharing and collaboration within theOpenStack community

    https://www.openstack.org/legal/transparency-policy/

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 18 / 54

    https://www.openstack.org/legal/transparency-policy/

  • Transparency: showing the data is not enough

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 19 / 54

  • Open development analytics

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 20 / 54

  • A new dimension of openness

    When we develop in the open

    we produce a great deal of data

    about how we develop

    Show me the development data

    as a step beyond

    show me the code

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 21 / 54

  • From open development to open development analytics

    Information about code, community, development

    for open development projects

    can be retrieved, organized, analyzed

    Lets publish analytics results & data

    Open Development Analytics:A new standard for transparencyJesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 22 / 54

  • Open development analytics

    Who may benefit?

    Developers

    Project managers

    Community managers

    Evaluators

    ...

    Anyone interested in the health of the project

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 23 / 54

  • Who may benefit?

    Slide used by Jim Zemlin at LF Collab 2016

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 24 / 54

  • Some areas of interest

    Performance (understanding activity)

    Company participation (beyond copyright

    notices)

    Transparency (available information)

    Auditing (certify participation, experience, etc.)

    Profiling (key people, companies)

    Neutrality (fair treatment)

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 25 / 54

  • How are changes beingreviewed?

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 26 / 54

  • Some reviewers are more equal than others

    http://blog.bitergia.com/2015/12/30/

    some-developers-are-more-equal-than-others/

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 27 / 54

    http://blog.bitergia.com/2015/12/30/some-developers-are-more-equal-than-others/http://blog.bitergia.com/2015/12/30/some-developers-are-more-equal-than-others/

  • Neutrality?

    0

    1

    2

    3

    250 500 1000 2000 4000Number of accepted reviews

    Itera

    tions

    per

    acc

    epte

    d re

    view

    (m

    edia

    n)

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 28 / 54

  • Dependency

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 29 / 54

  • Apache Pony Factor

    In words of Daniel Gruno:

    We [the ASF] created a term we have coinedPony Factor (because ASF is full of ponies, orpeople who think they are ponies). Pony Factor(PF) shows the diversity of a project in terms ofthe division of labor among committers in aproject.

    Pony Factor is determined as:The lowest number of committers whosetotal contribution constitutes the majority ofthe codebase

    https://ke4qqq.wordpress.com/2015/02/08/pony-factor-math/Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 30 / 54

    https://ke4qqq.wordpress.com/2015/02/08/pony-factor-math/

  • Bitergia Elephant Factor

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 31 / 54

  • Bitergia Elephant Factor

    Projects can benefit from powerful collaborationsfrom companies (elephants). The elephant factorshows the diversity of a project in terms of thedivision of labor among companies (by mean ofdevelopers affiliated with them).

    Elephant factor is determined as:The lowest number of companies whosetotal contribution (in commits by theiremployees) constitutes the majority of thecommits

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 32 / 54

  • Code owned

    The land belongsto its workers

    Emiliano Zapata

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 33 / 54

  • Code owned

    The code changes over time. The current version isowned by the people who produced it.

    The code belongs to those who wrote it.

    Zapata factor (work in progress):The lowest number of developers for whomthe total number of lines of code they own(were last touched by them) constitutes themajority of the lines of code

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 34 / 54

  • Diversity: Code owned

    [Linux kernel, July 2016, Zapata factor: 200]

    Jesus Gonzalez-Barahona (Bitergia) Open Development Analytics Paris, Nov 2016 35 / 54

  • Cod