Embed Size (px)
Citation preview
Infusing Self-awareness into Turing Machine:
A Path to Cognitive Distributed Computing
Dr. Rao Mikkilineni at IEEE WETICE2014
IEEE international Conference on
Enabling Technologies : Infrastructure for
Collaborative Enterprises
IEEE WETICE 2014 23rd IEEE WETICE Conference
Introduction – Why This Talk is More About WETICE
• Work started in a workshop in WETICE2009
• Theory proposed in WETICE 2010
• First implementation presented in WETICE 2011
• Published “The Turing O-Machine and the DIME Network Architecture:
Injecting the Architectural Resiliency into Distributed Computing” in Turing Centenary Conference proceedings 2012
• First commercial enterprise platform implementation 2013
• Hyper-Cloud implementation 2014
Major Contributors: Dr. Giovanni Morana, Ian Seylor, Dr. Daniele Zito
Other Contributors: Vijay Sarathy, Albert Camparini, Kumar Malavalli, Pankaj Goyal, Eugene Eberbach, Marco De Sano and C3 DNA team
Dr. Rao Mikkilineni at IEEE WETICE2014 2
There are two kinds of creation myths: those where life arises out of the mud, and those where life
falls from the sky.
In this creation myth, computers arose from the mud and code fell
from the sky.
- George Dyson “Turing's Cathedral: The Origins of the Digital Universe",
New York: Random House, 2012.
The DIME network
architecture arose out
of the need to manage
the ephemeral nature
of life in the Digital
Universe
“
“
In The Beginning………
Dr. Rao Mikkilineni at IEEE WETICE2014 3
Infusing architectural resiliency into the
Digital Universe:
Function, structure and fluctuations
Dr. Rao Mikkilineni at IEEE WETICE2014 4
The Sharp Right-Turn and Moore’s Law
Dr. Rao Mikkilineni at IEEE WETICE2014
Many-core processor is a marvel of timely
engineering that saved the day causing the
acceleration of the Digital Universe
5
Expanding Digital Universe
Dr. Rao Mikkilineni at IEEE WETICE2014
The Digital Universe created by the Turing/von
Neumann legacy is expanding at a rate of
– Two trillion transistors per second and
– Five trillion bits of storage per second
– George Dyson, Author of “Turing’s Cathedral: The Origins
of the Digital Universe”, New York: Random House, 2012.
6
Life in the Digital Universe Today
Super Competitive race for real-time customer insights
3
Credit : ScaleDB Blog
Big Data
Communication Collaboration and Commerce – Now at the speed of
Light!
1
Services Anytime, Anywhere
Hyper-scale fluctuations in customer consumption
2 Hyper-Fluctuations in
Demand
Dr. Rao Mikkilineni at IEEE WETICE2014 7
Technology Drivers
Virtualization has pretty much commoditized Hardware
Commoditization of Hardware
Ubiquitous on-demand pay-per-use access to IT creating an explosion of
services
2 Pay-per-use IT
Moore’s law of complexity adding to tool fatigue and cost of
service operations
3 Cost, Complexity
growing unsustainably
time
complexity
costs
1
Dr. Rao Mikkilineni at IEEE WETICE2014 8
IT’s all about Services now!
virtualized compute
software defined
networks
virtualized network storage
Hardware is a commodity
Clouds are the proven Operational Model
Services must be always available, anywhere
application components &
service networks
hyper-cloud
service consumers
serv
ice
B
Dr. Rao Mikkilineni at IEEE WETICE2014 9
Two Fundamental Issues that are in the way
Application
QoS
Distributed Systems
Management
QoS is dependent on distributed systems management 1 Complexity and costs of distributed systems
management increasing unsustainably 2
time
complexity
costs
Moore’s Law
Distributed
Systems
Management
Dr. Rao Mikkilineni at IEEE WETICE2014 10
Current State-of-the-art
Dr. Rao Mikkilineni at IEEE WETICE2014
VM
VM
VM
Main DC
Physical Servers
Virtual Servers
Storage
VM
VM
VM
Backup / Remote DC
Physical Servers
Virtual Servers
Storage
Cloud
System Management and Scaling Infrastructure Cloud Provider’s Management
Vendor Lock-In
Cloud Lock-In
Service Provider / IT Control
LOB Control
HA/DR
Bursting
LOB’s Quality of Service (QoS) Needs B Services
VM
Image Mgmt.
Orchestration APIs
Architecture
Costs Complexity Delayed Visibility
11
Physical HW
Virtualized Infrastructure
What is the Current State of the Art?
Dr. Rao Mikkilineni at IEEE WETICE2014
Service Operators
Service Developers
Develo
p
Deplo
y
Pro
vis
ion
D
eliv
er
Current state of the art
Infrastructure Providers
Service Assurance
Service / Application Quality of Service
IaaS
API API
API
12
Service / Application Quality of Service
What is the Current State of the Art?
Dr. Rao Mikkilineni at IEEE WETICE2014
Service Operators
Service Developers
Develo
p
Deplo
y
Pro
vis
ion
D
eliv
er
Problems with current state of the art
Infrastructure Providers
Service Assurance
• Multiple Orchestrators
• Too many infrastructure management tools
• Manager of Managers create complexity
• Cannot scale across distributed infrastructures
• Cannot work without VM Image Mobility
• Lack of end-to-end service security
• No support for low-latency transactions in cloud
Architecture, Vendor, API Lock-in
Costs & Complexity
No Service-Level
Visibility
Physical HW
Virtualized Infrastructure
13
nd
Dr. Rao Mikkilineni at IEEE WETICE2014
Service Operators
Service Developers
Develo
p
Deplo
y
Pro
vis
ion
D
eliv
er
C3DNA - End-to-end Service Delivery with QoS
Infrastructure Providers
Service Assurance
Service / Application Quality of Service
• Free Applications from Infrastructure Vendor and Cloud Provider lock-In.
• Take service Management out of infrastructure
• Decouple end to end service management
• Provide Legacy Application Modernization, Live Migration and Scale Across Cloud Providers (w/out code modification) and Intra/Inter DC
• Provide Real-Time Database Mirroring, Replication, Scaling and Cross Cloud Bursting (w/ out additional clustering software)
C3DNA
Service Delivery
Network
Physical HW
Virtualized Infrastructure
14
A New Approach – The Services Delivery Network
Dr. Rao Mikkilineni at IEEE WETICE2014
B
End Users
Private Data Center
Cloud Provider A
Hypercloud
Any Cloud
Provider
Dev-Ops
Workflows & Policies
captured in
Application DNA
End-to-End Service Transaction
Visibility
Quality of Service (QoS) Control
Line of Business
Service Delivery Network
Managed
workflows
Services management decoupled
from infrastructure management
systems at run-time
15
Key Highlights of The New Approach
• Key Highlights of the Technology
– No infrastructure changes required.
Overlays on existing Infrastructure.
– No changes to existing applications, OS or Kernel
– Independent of development
environment, IDE or language
– No reboot required for migration. Easily
rolled back.
• Hypercloud Services Delivery
– Works with any existing Application
runtime environments, databases
– Works with physical and virtual infrastructure
– No integration with infrastructure management – Service Management decoupled with distributed infrastructure management systems
– Application monitors / sensors
– Proactive policy management
– Runtime application control
Dr. Rao Mikkilineni at IEEE WETICE2014 16
What Enterprises Are Saying About The New Approach
“The stuff you’re fixing is the stuff that makes my life a living hell!”
Gordon Tannura SVP Sabre Travel
Network Development
“This will be in everyone’s toolbox as the best move in IT since virtualization”
Rick McCarthy VP, Engineering
Dr. Rao Mikkilineni at IEEE WETICE2014 17
Visualizing How it Works
Dr. Rao Mikkilineni at IEEE WETICE2014 18
Any other Clouds
Service-Level scaling in the Hypercloud
Dr. Rao Mikkilineni at IEEE WETICE2014
Private Data Center
AWS
Service
Service
User
Scaling
event
Service
Developer
Service–level QoS, visibility &
control
19
Any Other Clouds
Service-Level HA/DR in Hypercloud
Dr. Rao Mikkilineni at IEEE WETICE2014
AWS
Multi-Master DB Service
Service
Developer
Service–level QoS ensured
using Hypercloud
Service
User
Private Data Center
20
Any Other Clouds
Self-Repair in the Hypercloud
Dr. Rao Mikkilineni at IEEE WETICE2014
Private Data Center
Service User
Service
Service
Developer
Service–level QoS ensured
using Hypercloud
AWS
21
Any Other Clouds
Self-Repair in the Hypercloud
Dr. Rao Mikkilineni at IEEE WETICE2014
Private Data Center
AWS
Service User
Service
Service
Developer
Service–level QoS ensured
using Hypercloud
22
How We Got from Turing Machines to
Cognitive Computing and Communications:
The DIME Network Architecture
Dr. Rao Mikkilineni at IEEE WETICE2014
WETICE 2009 to 2013
23
The Triumph of the Turing Machine (TM)
• Constructive Model with tractable explicit descriptions and simple rules for operation
• TM implementation using von Neumann stored program control with data program duality has allowed modeling, reasoning and controlling of any physical system
Dr. Rao Mikkilineni at IEEE WETICE2014 24
Good old fashioned AI
• Knowledge is represented
symbolically and the system
attempts to reason using the
symbolic knowledge
• Formal way of representing the
state of the world and reasoning
about it
• Logic programming systems,
such as Prolog, compute the
consequences of the axioms and rules in order to answer a
query
Dr. Rao Mikkilineni at IEEE WETICE2014 25
Connectionism
• Loosely inspired by the brain
• Number of neurons connected to
each other
• Each connection has a particular
weight
• Activity in one neuron is passed to
the connected neurons
• Variety of types and network
architectures
Dr. Rao Mikkilineni at IEEE WETICE2014 26
Cognitive Computing & Autonomic Computing
• Cognition is the ability to process
information, apply knowledge, and
change the circumstance.
• Cognition is associated with intent and its
accomplishment through various
processes that monitor and control a
system and its environment.
• Cognition is associated with a sense of
“self” (the observer) and the systems with which it interacts (the environment or the
“observed”). • Cognition extensively uses time and
history in executing and regulating tasks
that constitute a cognitive process.
Dr. Rao Mikkilineni at IEEE WETICE2014 27
Computation and its Limits
GOFAI “gravitates towards those cognitive tasks like natural language, formal reasoning, planning, mathematics, and playing chess, in which the processing of abstract symbols in a logical fashion. It does not take into account an active organism’s synergistic interactions of the mind, body and the environment where the notion of dynamic coupling (each change in one element of a system continuously influences every other element’s change) is not taken into account”
– Louis Barrett, Beyond the Brain, Princeton University Press: Princeton (2011)
CONNECTIONISM - can model temporal sequences, the standard connectionist models are not sufficiently powerful because they do not include reliable structure in the environment. In addition, “connectionist modelers tend to think in terms of single tasks and the most common forms of network are not good at handling multiple tasks which interact.”
– Wells, A. (2006). Rethinking Cognitive Computation: Turing and the Science of Mind. Palgrave Macmillan: London.
Dr. Rao Mikkilineni at IEEE WETICE2014 28
Computation and its limits
Dr. Rao Mikkilineni at IEEE WETICE2014
“The key property of general-purpose computer is that they are general purpose. We can use them to deterministically model any physical system, of which they are not themselves a part, to an arbitrary degree of accuracy. Their logical limits arise when we try to get them to model a part of the world that includes themselves.”
Cockshott P., MacKenzie L. M., and Michaelson, G, (2012) Computation and its Limits, Oxford University Press, Oxford.
A non-functional requirement is a requirement that specifies criteria that can be used to judge the operation of a system, rather than specific behaviors. This should be contrasted with functional requirements that define specific behavior or functions. The plan for implementing functional requirements is detailed in the system design. The plan for implementing non-functional requirements is detailed in the system architecture. These requirements include availability, reliability, performance, security, scalability and efficiency at run-time.
It is the architecture stupid!
29
The Hyper-Computing controversy
Is interactive computing
modeled by a TM
Function, Structure
& Fluctuations
Dr. Rao Mikkilineni at IEEE WETICE2014
Process Evolution
30
The Turing O-Machine
• Oracle must be more knowing than the TM it
manages
• Able to influence the computation based on its
knowledge
• Provides the ability to infuse cognition into
computing
• Allows Super-Recursive Computing
Dr. Rao Mikkilineni at IEEE WETICE2014 31
Infusing Sensors and Actuators into the TM
Dr. Rao Mikkilineni at IEEE WETICE2014
Self-Awareness: Application is embedded with
parallel resource monitors and
configuration Managers to optimize resources
Self-Reasoning: Signaling overlay network allows
service transaction policy management and distributed
reasoning at run-time
Self-Control: File/device Read/Write control
based on local policies driven by global policies and soft-switch for
I/O redirection at run-time
32
Dr. Rao Mikkilineni at IEEE WETICE2014
Distributed
Application DNA
Control Platform
• Components • Configuration • Workflows • Policies
Application
DNA
Interprets Application DNA in order to ensure Application
Intent continuously
Captures Application Intent
OS
Runtime
OS
Runtime
OS
Runtime
B
1 2 3
Self-Constituting, Self-Aware, Self Healing Environment using
Existing IT
Cognitive Container-
based Application
Environment
DIME Network Architecture (DNA)
Process
Management DNA
Super-Oracle
Managed
Structure &
Dynamics
TM
Oracle
Managed
Functions
33
Hyper-Cloud Service Network with DNA
WiFi GPON TCP/IP Voice Video
Internet of
Things with
Container
SDN
Access Gateway
WAN Service
Provider
SDN SDN
Private or
Managed
Datacenter Public
Cloud
Application Components
Service Networks and
Services switching
The Future
Dr. Rao Mikkilineni at IEEE WETICE2014 34
Application to Cloud Computing – Hypercloud
Dr. Rao Mikkilineni at IEEE WETICE2014 35
Where To Go From Here
Theory • Super-recursive computing and the theory of computational
efficiency
• Process Algebra
• .......
Practice • Highly scalable distributed cognitive computing with high
efficiency – The Hypercloud (cloud of distributed clouds) with service mobility across physical or virtual servers
• The integration of the computer and the computed – Borderless Computing with Cognition & Compliance
• New class of distributed and parallel computing
Dr. Rao Mikkilineni at IEEE WETICE2014 36
The evolution of computing – Unification of the computer and the Computed
Dr. Rao Mikkilineni at IEEE WETICE2014
Scaling with number of compute elements
Syste
m R
esili
ency
Conventional
computing
Cloud
Computing
Beyond Turing Machines:
The DIME Network Architecture
Complexity cliff
Automation of Administration
Model of part of a world that include themselves
(Computers)
37
Partial List of References
• Mikkilineni R. (2011). Designing a New Class of Distributed Systems. Springer: New York. ISBN: 1461419239
• Mikkilineni R., Comparini A., Morana G., (2012). The Turing O-Machine and the DIME Network Architecture: Injecting the Architectural Resiliency into Distributed Computing, In Turing-100. The Alan Turing Centenary, (Ed.) Andrei Voronkov, EasyChair Proceedings in Computing, Volume 10,
• http://www.easychair.org/publications/?page=877986046 • Mikkilineni R., Morana G., Zito D., and Di Sano M. (2012). Service Virtualization Using a Non-von
Neumann Parallel, Distributed, and Scalable Computing Model. Journal of Computer Networks and Communications.
• Mikkilineni, R., & Seyler, I. (2011). A New Operating System for Scalable, Distributed, and Parallel Computing. Parallel and Distributed Processing Workshops and Ph,d Forum (IPDPSW), 2011 IEEE International Symposium on, (pp. 976-983).
• Mikkilineni, R., Morana, G., & Seyler, I. (2012). Implementing Distributed, Self-managing Computing Services Infrastructure using a Scalable, Parallel and Network-centric Computing Model. In M. Villari, C. I. Brandic, & F. Tusa, Achieving Federated and Self-Manageable Cloud Infrastructures: Theory and Practice (pp. 57-78). IGI Global.
• Mikkilineni, R. (2012). Applied Mathematics, 3, 1826-1835 doi:10.4236/am.2012.331248 Published Online November 2012 (http://www.SciRP.org/journal/am)
• Morana, G., and Mikkilineni, R. (2011). Scaling and Self-repair of Linux Based Services Using a Novel Distributed Computing Model Exploiting Parallelism. 20th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE) (pp. 98-103). IEEE.
Dr. Rao Mikkilineni at IEEE WETICE2014 38
