58
Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology OR AND AND 1 x 2 x 3 x 1 f 2 f 3 f

Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Embed Size (px)

Citation preview

Page 1: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Marc D. RiedelAssistant Professor, ECE University of Minnesota

EE 5393: Circuits, Computation and BiologyEE 5393: Circuits, Computation and Biology

ORAND AND

1x 2x 3x

1f 2f 3f

Page 2: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“Minnesota Farmer”

• Most of the cells in his body are not his own!

• Most of the cells in his body are not even human!

• Most of the DNA in his body is alien!

Who is this guy?

Page 3: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“Minnesota Farmer”

• 100 trillion bacterial cells of at least 500 different types inhabit his body.

Who is this guy?

He’s a human-bacteria hybrid:

vs.

• only 1 trillion human cells of 210 different types.

[like all of us]

Page 4: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“Minnesota Farmer”

Who is this guy?What’s in his gut?

• 100 trillion bacterial cells of at least 500 different types inhabit his body.

He’s a human-bacteria hybrid:

vs.

• only 1 trillion human cells of 210 different types.

[like all of us]

Page 5: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

About 3 pounds of bacteria!

What’s in his gut?“E. coli, a self-replicating object only a thousandth of a millimeter in size, can swim 35 diameters a second, taste simple chemicals in its environment, and decide whether life is getting better or worse.”

– Howard C. Berg

flagellum

Page 6: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Bacterial Motor

Page 7: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Bacterial Motor

Electron Microscopic Image

Page 8: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“Stimulus, response! Stimulus response! Don’t you ever think!”

We should put these critters to

work…

Page 9: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Synthetic Biology

• Positioned as an engineering discipline.– “Novel functionality through design”.– Repositories of standardized parts.

• Driven by experimental expertise in particular domains of biology.– Gene-regulation, signaling, metabolism,

protein structures …

Page 10: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Building Bridges

"Think of how engineers build bridges. They design quantitative models to help them understand what sorts of pressure and weight the bridge can withstand, and then use these equations to improve the actual physical model. [In our work on memory in yeast cells] we really did the same thing.”

– Pam Silver, Harvard 2007

• Quantitative modeling.• Mathematical analysis.• Incremental and iterative design changes.

Engineering Design

Page 11: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Building Digital Circuits

Intel 4004(1971)

Intel “Nehalem”(2008)

~2000 gates

~2 billion gates

Page 12: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

inputs outputs

• Design is driven by the input/output specification.• CAD tools are not part of the design process; they are

the design process.

Building Digital Circuits

),,( 11 mxxf a

),,( 12 mxxf a

),,( 1 mn xxf a

1x

2x

mx

digital circuit

...

Page 13: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Synthetic Biology

• Cellulosic ethanol (Nancy Ho, Purdue, ’04)

• Anti-malarial drugs (Jay Keasling, UC Berkeley, ‘06)

• Tumor detection (Chris Voigt, UCSF ‘06)

Feats of synthetic bio-engineering:

Strategy: apply experimental expertise; formulate ad-hoc designs; perform extensive simulations.

Page 14: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

From ad hoc to Systematic…

Claude E. Shannon1916 –2001

“A Mathematical Theory of Communication,” Bell System Technical

Journal, 1948.

Basis of information theory, coding theoryand all communication systems.Basis of all digital computation.

“A Symbolic Analysis of Relay and Switching Circuits,”

M.S. Thesis, MIT, 1937

Page 15: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

[computational] Synthetic Biology[computational] Analysis

“There are known ‘knowns’; and there are unknown ‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2004

BiologicalProcess

Molecular Inputs

Molecular Products

KnownKnown

UnknownKnown /Unknown

UnknownGiven

Page 16: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Artificial Life

US Patent 20070122826 (pending):“The present invention relates to a minimal set of protein-coding genes which provides the information required for replication of a free-living organism in a rich bacterial culture medium.” – J. Craig Venter Institute

Going from reading genetic codes to writing them.

Page 17: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Artificial Life

Going from reading genetic codes to write them.

Moderator: “Some people have accused you of playing God.”

J. Craig Venter:“Oh no, we’re not playing.

Page 18: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Biochemistry in a Nutshell

DNA: string of n nucleotides (n ≈ 109)

... ACCGTTGAATGACG...

},,{},,,{ 2013 aaGTCA

Nucleotides:

Amino acid: coded by a sequence of 3 nucleotides.

Proteins: produced from a sequence of m amino

acids (m ≈ 103).

},,,{ GTCA

protein},,{ 201 maa

Page 19: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

The (nano) Structural Landscape

“You see things; and you say ‘Why?’ But I dream things that never were; and I say ‘Why not?’"

– George Bernard Shaw, 1925

Novel Materials…

Novel biochemistry…

Novel biological functions…

Page 20: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Jargon vs.Terminology

“Now this end is called the thagomizer, after the late Thag Simmons.”

Page 21: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

The Computational Landscape“There are known ‘knowns’; and there are unknown

‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2002

Semiconductors:exponentially smaller, faster, cheaper – forever?

1 transistor (1960’s)2000 transistors(Intel 4004, 1971)

800 million transistors(Intel Penryn, 2007)

Page 22: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

The Computational Landscape

• Abutting true physical limits.

• Cost and complexity are starting to overwhelm.

“There are known ‘knowns’; and there are unknown ‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2002

Semiconductors:exponentially smaller, faster, cheaper – forever?

Page 23: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

The Computational Landscape

• Multiple cores?• Parallel Computing?

Potential Solutions:

“There are known ‘knowns’; and there are unknown ‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2002

Page 24: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

The Computational Landscape

b

a?

• Novel Materials?

Potential Solutions:

• Novel Function?

“There are known ‘knowns’; and there are unknown ‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2002

Page 25: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

gene

The Computational Landscape“There are known ‘knowns’; and there are unknown

‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2002

RNAp outputprotein

Page 26: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

repressorprotein

The Computational Landscape

gene

“There are known ‘knowns’; and there are unknown ‘unknowns’; but today I’ll speak of the known ‘unknowns’.”

– Donald Rumsfeld, 2002

RNAp

Biological computation?

nada

Page 27: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Research Activities in my Lab

• The concurrent logical and physical design of nanoscale digital circuitry.• The synthesis of stochastic logic for robust polynomial arithmetic.• Feedback in combinational circuits.• High-performance computing for the stochastic simulation of

biochemical reactions.• The analysis and synthesis of stochasticity in biochemical systems.

Our research activities encompass topics in logic synthesis and verification, as well as in synthetic and computational biology. A broad theme is the application of expertise from the realm of circuit design to the analysis and synthesis of biological systems. Current projects include: ?

Page 28: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND
Page 29: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Research Activities in my Lab

• We’re studying the mathematical functions for digital circuits. • We’re writing computer programs to automatically design such circuits.

• We’re studying the concepts, mechanisms, and dynamics of intracellular biochemistry.

• We’re writing computer programs for analyzing and synthesizing these dynamics.

CircuitsCircuits

BiologyBiology

Page 30: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND
Page 31: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Two Made-Up Facts[well, abstractions, really…]

1x

2x

g

Logic Gates

Biochemical Reactions

+

Page 32: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“AND” gate

0001

1x

2x

g0011

0101

1x 2x g

Logic Gates

Page 33: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“XOR” gate

0011

0101

0110

1x

2x

g

1x 2x g

Logic Gates

Page 34: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

),,( 11 mxxf a

),,( 12 mxxf a

),,( 1 mn xxf a

inputs outputs

Digital Circuit

1x

2x

mx

circuit

Page 35: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

),,( 1 mn xxf a

),,( 11 mxxf a

),,( 12 mxxf a),,( 1 mxxf a

inputs outputs

1x

2x

mx

circuit gate

Digital Circuit

Page 36: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

1x

2x

3x

4x

5x

6x

NAND

OR

ANDAND

AND

NOR

1

0

0

1

1

1

1

0

1

0

0

1

Digital Circuit

Page 37: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

My PhD Dissertation[yes, in one slide…]

x1

x1

x1

x1

x2

x2

x3

x3

Page 38: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

It’s not a bug, it’s a feature.

Page 39: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

circuit0

1

Characterize probability of outcomes.

inputs outputs

Model defects, variations, uncertainty, etc.:

Current Research

Page 40: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

circuit

inputs outputs

Model defects, variations, uncertainty, etc.:

0,1,1,0,1,0,1,1,0,1,…

1,0,0,0,1,0,0,0,0,0,…

p1 = Prob(one)

p2 = Prob(one)

Current Research

Page 41: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

circuit

inputs outputs

Model defects, variations, uncertainty, etc.:

51

52

Current Research

Page 42: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND
Page 43: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Biochemical Reactions

9

6

7

cellprotein count

+

8

5

9

Page 44: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Biochemical Reactions

+

+

+

slow

medium

fast

Page 45: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND
Page 46: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Bacteria are engineered to produce an anti-cancer drug:

Design Scenario

drugtriggering compound E. Coli

Page 47: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Bacteria invade the cancerous tissue:

cancerous tissue

Design Scenario

Page 48: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

cancerous tissue

The trigger elicits the bacteria to produce the drug:

Design Scenario

Bacteria invade the cancerous tissue:

Page 49: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

cancerous tissue

Problem: patient receives too high of a dose of the drug.

Design Scenario

The trigger elicits the bacteria produce the drug:

Page 50: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Design Scenario

• Bacteria are all identical.• Population density is fixed.• Exposure to triggering compound is uniform.

Constraints:

• Control quantity of drug that is produced.

Requirement:

Conceptual design problem.

Page 51: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

cancerous tissue

Approach: elicit a fractional response.

Design Scenario

Page 52: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

produce drug

triggering compound E. Coli

Approach: engineer a probabilistic response in each bacterium.

with Prob. 0.3

don’t produce drugwith Prob. 0.7

Synthesizing Stochasticity

Page 53: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Engineering vs. Biology vs. Mathematics

Dilbert Beaker Papa

Page 54: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Communicating Ideas

Page 55: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Domains of Expertise

• Vision• Language• Abstract Reasoning• Farming

Human

Circuit

• Number Crunching

• Mining Data• Iterative

Calculations

Page 56: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

“A person's mental activities are entirely due to the behavior of nerve cells, glial cells, and the atoms, ions, and molecules that make them up and influence them.”

– Francis Crick, 1982

Astonishing Hypothesis

“That the astonishing hypothesis is astonishing.”

– Christophe Koch, 1995

The Astonishing Part

Page 57: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

Circuits & Computers as a Window into our Linguistic Brains

CircuitBrainConceives of circuits and

computation by “applying” language.

Lousy at all the tasks that the brain that

designed it is good at (including language).

?

Page 58: Marc D. Riedel Assistant Professor, ECE University of Minnesota EE 5393: Circuits, Computation and Biology ORAND

If You Don’t Know the Answer…