From Open Source to Inner Source - Linux Foundation Events · open source projects bug fixes, patches and code enhancements to (existing) open source projects ... Troubleshooting

From Open Source to Inner Source

Eyal Felstaine, Ph.D.

CTO, Amdocs Technology

April 3, 2019

How Open Source ONAP Has Changed Amdocs

Information Security Level 2 – Sensitive

© 2017 – Proprietary & Confidential Information of Amdocs2

ECOMP

AT&T’s ECOMP co-created by AT&T and Amdocs



Open Source ECOMP

Open Source Platform Convergence

ONAP to become the de-facto industry standard

open source platform for NFV/SDN automation


© 2017 – Proprietary & Confidential Information of Amdocs6Information Security Level 2 – Sensitive


We had to

redesign

our culture



include open source code in

products or services

initiate and moderate NEW

open source projects

bug fixes, patches and code enhancements

to (existing) open source projects

Open source – modes of engagement



Troubleshooting an NFV issue – with closed source

VNF vendor Customer in production1. Automation script

doesn’t run

2. Operations notifies

engineering

3. Engineering notifies VNF

vendor tech support

4. Tech support discusses

with product manager

5. VNF product manager

discusses with

orchestrator product

manager

6. Development starts

on both sides

7. Testing

8. F2F meeting to

triangulate the issue

Operations

Engineering

1Product

management

Development

Testing

Tech support

88

6

7

Product

management

Development

Testing

Tech support

6

7

4

3

5

8

5

Proprietary/closed

code orchestrator

25



Open

Source

Orchestrator

1. Automation script

doesn’t run

2. Due to automation

script problem,

Operations notifies

engineering

3. Engineering notifies

VNF Vendor tech

support

4. VNF vendor contributes

code in order to fix

the problem

Operations

2

1

3

44

Troubleshooting an NFV issue – with open source

5

VNF vendor Customer in production

Engineering



Operations

EngineeringDevOps

Development & Operations

VNF vendorOpen

source

Orchestrator

Customer in production

Troubleshooting an NFV issue – with open source



Troubleshooting an NFV issue

Proprietary/closed source

Massively deployed open source

Open source accelerates the speed of innovation

Open source Orchestrator

Operations

2

1

3

44

5


Engineering


Operations

Engineering

1Product

management

Development

Testing

Tech support

88

6

7

Product management

Development

Testing

Tech support

6

7

4

3

5

8

5

25

Proprietary/closed code orchestrator



Troubleshooting NFV issue

Proprietary /

closed source

Massively deployed

open source




We then realized…

…that we need to change course

of internal development as well

to look inside



Extremely complex process of incident handling

Customer in

production

Product1. Service desk team

identifies an issue

2. Service restoration2a. Triage with operation, IT, infra, ADM, vendors, customer

2b. Work around solution by ADM or infra2c. Testing the work around2d. Deployment

3. Permanent fix3a. Triage w. Services, Delivery and Product3b. Fix development3c. Production

Product

management

Development

Testing

Support

Services

Operations

Customer

Operations

Manager

Applications,

Deployment &

management

Operations

UAT

Support

Delivery

Scoping

Development

Testing

Infra / IT

3rd parties

1

2d

2d

2b

2b

2c

2a

2a

2a

2a2a

2a

3a

3a 3a

3a

3a

3b

3b 3b

3b

3c

3c

2a



TTM without inner sourceSimple fix requested by a customer

Development effort Many Emails

Handful of Employees

actively involved

# of Software Engineers in

the discussion

~26.3 Daysfrom first reference to

production



From spaghetti to efficiency

Product

management

Development

Testing

Support

Operations

Customer

Operations

Manager

Applications,

Deployment &

management

Operations

UAT

Support

Scoping

Development

Testing

Infra / IT

2a12d

2c

2a

2a2a

3a

3a 3a

3a

3a

3b 3b 3c

3c

2d

2b

2b2a

3b

3b

2a

Customer in

production

Product ServicesDelivery





Because of the

So… why inner sourcing?

Modernize Org. Culture

Improve Security

Code Quality

Improve Productivity

Innovation

Agility




How to inner source?



Open source foundation roles

Technical Steering Committee (TSC)

Project Technical Lead (PTL)

Committer

Contributor




We redesigned

our culture



Thank you

Documents

From Open Source to Inner Source - Linux Foundation Events · open source projects bug fixes, patches and code enhancements to (existing) open source projects ... Troubleshooting