86
Hybridization of complete and incomplete methods to solve CSP Tony Lambert Solving CSP Hybrid solving : need a framework Integrate split in GI Theoretical model for hybridization CP + LS Theoretical model for hybridization CP + GA To an uniform framework CP + GA + LS Conclusion and future works Hybridization of complete and incomplete methods to solve CSP Tony Lambert LERIA, Angers, France LINA, Nantes, France October 27th, 2006 Rapporteurs : François FAGES Directeur de Recherche, INRIA Rocquencourt Bertrand NEVEU, Ingénieur en Chef des Ponts et Chaussées, HDR Examinateurs : Steven PRESTWICH, Associate Professor, University College Cork Jin-Kao HAO, Professeur à l’Université d’Angers Directeurs de thèse : Éric MONFROY, Professeur à l’Université de Nantes Frédéric SAUBION, Professeur à l’Université d’Angers 1 / 86

Slides Ph D Defense Tony Lambert

Embed Size (px)

DESCRIPTION

Hybridization of complete andincomplete methods to solve CSP

Citation preview

Page 1: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Hybridization of complete andincomplete methods to solve CSP

Tony Lambert

LERIA, Angers, France

LINA, Nantes, France

October 27th, 2006

Rapporteurs : François FAGES Directeur de Recherche, INRIA RocquencourtBertrand NEVEU, Ingénieur en Chef des Ponts et Chaussées, HDR

Examinateurs : Steven PRESTWICH, Associate Professor, University College CorkJin-Kao HAO, Professeur à l’Université d’Angers

Directeurs de thèse : Éric MONFROY, Professeur à l’Université de NantesFrédéric SAUBION, Professeur à l’Université d’Angers

1 / 86

Page 2: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Constraint programming process

Formulate the problem with constraints as a CSPconstraint : a relation on variables and their domainsConstraint Satisfaction Problem (CSP) : a set ofconstraints together with a set of variable domains

CSP model

X

Y

U

TZ

C1

C2

C5C4

C3

Variables Constraints

X = x1, . . . , xn set of nvariables,D = Dx1 , . . . , Dxn setof n domains,C = c1, . . . , cm set ofm constraints.

2 / 86

Page 3: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Problems are modeled as CSPs (X , D, C)

Some variables to represent objects(X = X1, . . . , Xn)

Domains over which variables can range(D = D1 × . . .× Dn)

Some constraints to set relation between objects

C1 : X ≤ Y ∗ 3C2 : Z 6= X − Y. . .

3 / 86

Page 4: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Example : Sudoku problem

3 5 1

1 5 6 3 7

6 9 1 4

3 6 9 8

8

1 9 7

9 5

8 4 6 7

9 5

1 63 4 5 7 8 9

2

2

2

2

2

X = all the cells in the grid,D = to each cell a value in [1..9],C = set of alldiff constraints : all digits appears onlyonce in each row ; once in each column and once ineach 3× 3 square the grid has been subdivided

4 / 86

Page 5: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Example : 8 Queens

X = x1, ...x8 Columns,D = Dx1 , ..., Dx8 for each columns, the row thequeen is placed Dxi = [1..8],C = not 2 queens in the same row or samediagonal

5 / 86

Page 6: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

CSP solving

A solutionGiven a search space S = Dx1 × ...× Dxn

an assignment s is a solution if :s ∈ S and∀c ∈ C, s ∈ c

Solving a CSP can be :compute whether the CSP has a solution(satisfiability)

find A solution

find ALL solutions

find optimal solutions (global optimum)

find A good solution (local optimum)

6 / 86

Page 7: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Outline

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

7 / 86

Page 8: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

8 / 86

Page 9: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

complete/incomplete methods

complete methods (such as propagation + split)

complete exploration of the search space

detect if no solution

global optimum

generally slow for hard combinatorial problems

incomplete methods (such as local search)

focus on some “promising” parts of the search space

do not detect if no solution

no global optimum

“fast” to find a “good” solution

9 / 86

Page 10: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Solving CSP

MethodsComplete methodsIncomplete methods

10 / 86

Page 11: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Complete methods

General methods that can be adapted to severaltypes of constraints and several types of variables

search methods : to explore the search spaceconstraint propagation algorithms : to repeatedlyremove inconsistent values from domains ofvariables

11 / 86

Page 12: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

First approach

Complete MethodsSearch space : Dx1 × · · · × Dxn

Enumerate all assignments

Backtrackingsearch (backtrack)Select variablesSplit / enumeration

12 / 86

Page 13: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Backtracking for 4 - Queens

13 / 86

Page 14: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Constraint propagation : reducing domains

Generally :reduce domains using constraint and domains→ reduce the search space

Generic domain reduction :given a constraint C over x1, . . . , xn with domainsD1, . . . , Dn

select a variable xi reduce its domaindelete from Di all values for xi that do not participatein a solution of C

14 / 86

Page 15: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Forward Checking

15 / 86

Page 16: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Constraint propagation

constraint propagation mechanism : repeatedlyreduce domainsreplace a CSP by a CSP which is :

equivalent (same set of solutions)“smaller” (domains are reduced)

16 / 86

Page 17: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Constraint propagation framework

Can be seen as a fixed point of application ofreduction functions

reduction function to reduce domains or constraintscan be seen as an abstraction of the constraints byreduction functions

Chaotic iterationCompute a limit of a set of functions [Cousot andCousot 77]monotonic and inflationary functions in a genericalgorithm to achieve consistency [Apt 97]

17 / 86

Page 18: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Abstract model K.R. Apt [CP99]For propagation (based on chaotic iterations)

Applicationof functions

Abstraction

Constraint

CSPFixed point

Partial Ordering

Reduction functions

18 / 86

Page 19: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Partial ordering and functionsPartial OrderingGiven a CSP (X ,D, C)

P(D) : all possible subset from Dv : subset relation ⊇

=⇒ (P(D),v) is a partial ordering

FunctionsGiven a set F of functions on D, every f ∈ F is :

inflationary : x v f (x)

monotonic : x v y implies f (x) v f (y)

idempotent : f (f (x)) = f (x)

=⇒ Every sequence of elements d0 v d1 v ... withdj = fij (dj−1) stabilizes to a fix point.

19 / 86

Page 20: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Example of reduction functions (1)Constraint x < y

10

8

6

7

96

3

4

5

7

D yx

D

5

Arc_consistence on Dx and Arc_consistence on Dy

10

8

5

6

7

96

3

4

5

7

D yx

D

10

8

5

6

7

96

3

4

5

7

D yx

D

20 / 86

Page 21: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Example of reduction functions (2)

Arc consistencyConsider a constraint x < y with Dx = [5..10] andDy = [3..7] then 2 functions D → D :

Arc_consistence 1 :

(Dx , Dy ) 7→ (Dx ′, Dy )

s.t.Dx ′ = a ∈ Dx | ∃b ∈ Dy , a < b

Arc_consistence 2 :

(Dx , Dy ) 7→ (Dx , Dy ′)

s.t.Dy ′ = b ∈ Dy | ∃a ∈ Dx , a < b

21 / 86

Page 22: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

A Generic Algorithm to reach fixpoint

for constraint propagation : ordering on size of domainswork on a CSPF = set of propagation functionsX = initial CSPG = FWhile G 6= ∅

choose g ∈ GG = G − gG = G ∪ update(G, g, X )X = g(X )

EndWhile

22 / 86

Page 23: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Solving CSP

MethodsComplete methodsIncomplete methods

23 / 86

Page 24: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Second Approach

Incomplete methodsheuristics algorithmsMetaheuristics

two familiesLocal search

Simulated annealing [Kirkpatrick et al, 1983]Tabu Search [Glover, 1986]...

Evolutionary AlgorithmsGenetic Algorithms [Holland, 1975]Genetic programming [Koza, 1992]...

24 / 86

Page 25: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Incomplete methods

DefinitionsExplore a D1 × D2 × · · · × Dn search spaceMove from neighbor to neighbor (resp. generation togeneration) thanks to an evaluation function

IntensificationDiversification

Properties :focus on some “promising” parts of the search spacedoes not answer to unsat. problemsno guaranteed“fast” to find a “good” solution

25 / 86

Page 26: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Local search (1)

Search space : set of possible configurationsTools : neighborhood and evaluation function

s 1 s 2

s 3 s 4

s 5

s 6

Set of

configurationspossible

26 / 86

Page 27: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Local search (2)

Search space : set of possible configurationsTools : neighborhood and evaluation function

s 1 s 2

s 3 s 4

s 5

s 6

Neighborhoodof s Set of

configurationspossible

27 / 86

Page 28: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Local search (3)

Search space : set of possible configurationsTools : neighborhood and evaluation function

s 1 s 2

s 3 s 4

s 5

s 6

Neighborhoodof s Set of

possibleconfigurations

28 / 86

Page 29: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Local search (4)

Search space : set of possible configurationsTools : neighborhood and evaluation function

s 1

s 1

2s s n

2s s n s n+1

p = (

p’ = (

LS(p) = p’

,

, , ...,

, ..., )

, )

of sNeighborhood

Set ofpossibleconfigurations

ss

ss

ss

21

34

5

6

29 / 86

Page 30: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Genetic algorithms (1)

Search space : set of possible configurationsTools : population, crossing, mutations, andevaluation function

8 6 2 4 91

4 9 4 2 5

2 4 91

1

4 2

Population k

Population k+1

x

y

30 / 86

Page 31: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Genetic algorithms (2)

Search space : set of possible configurationsTools : population, crossing, mutations, andevaluation function

4 9 4 2 5

41

1

4

Population k

Population k+19 58

x

y

31 / 86

Page 32: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSPPropagation + Split

Local Search

Genetic Algorithms

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Genetic algorithms (3)

Search space : set of possible configurationsTools : population, crossing, mutations, andevaluation function

Population k+1

Population k

Nouvelle Population

Mutation

Croisement

32 / 86

Page 33: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

33 / 86

Page 34: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Hybridization : getting the best of the both

Efficiency : faster complete solverQuality : better solutions (better optimum)Generally :

Ad-hoc systems (designed from scratch)Dedicated to a class of problemsMaster-slave approaches (LS for CP, CP for LS)

34 / 86

Page 35: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Hybridization : Overview

complete and incomplete methods combinations

collaborative combinations

integrative combinaisons

Incorporate a metaheuristic in complete methods

Incorporate a complete method in metaheuristics

35 / 86

Page 36: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

CP for LS

s 1 s 2

s 3 s 4

s 5

s 6

Neighborhoodof s

configurationspossibleSet of

Reduced

search space

Valid neighborhoodof s

36 / 86

Page 37: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

CP for GA (1)

Population

possibleSet of

configurations

37 / 86

Page 38: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

CP for GA (2)

Feasible population

possibleSet of

configurations

38 / 86

Page 39: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a frameworkWhy hybridizationcomplete/incomplete

Hybridization : getting thebest of the both

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Hybridization : getting the best of the both

Idea :

fine grain hybridizationfiner strategiesevery technique at the same levelone algorithm squeletoneasier to modify, extend, compare, ...

39 / 86

Page 40: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

40 / 86

Page 41: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Our purpose :

Use of an existing theoretical model for CSP solvingDefinition of the solving process

Integrate :SplitLSGA

41 / 86

Page 42: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Search Tree

propagation

split

propagation

split

propagation

split

propagation

CSP1

CSP1’

CSP2 CSP3

CSP2’ CSP3

CSP4 CSP5 CSP3

CSP4 CSP5 CSP3’

CSP5 CSP7 CSP8CSP6’

CSP4 CSP5 CSP6 CSP7 CSP8

42 / 86

Page 43: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Idea 1 : Integrate split in GI

use the CP framework algorithmsplit and reduction at the same levelwork on union of CSP

43 / 86

Page 44: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Theoretical model for CSP solving (2)

Reduction : by constraint propagation :

Ω Ω’

CSP1 CSP3Ω

CSP2’ CSP3CSP1Ω

Constraint Propagation

CSP2

44 / 86

Page 45: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Theoretical model for CSP solving (3)

Reduction by domain splitting :

Ω Ω’

CSP1 CSP2’ CSP2’’’CSP2’’ CSP3Ω

CSP1 CSP3ΩSplit

CSP2

45 / 86

Page 46: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GIConstraint propagation

Domain splitting

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Theoretical model for CSP solving (1)Partial ordering :

Ω1

Ω2

Ω3

Ω4

Ω5

Terminates with a fixed point : set of solutions or inconsistent CSP

Set of CSP

Application of a reduction :

domain reduction function or

splitting function

46 / 86

Page 47: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

47 / 86

Page 48: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Our purpose :

Use of an existing theoretical model for CSP solvingDefinition of the solving process

Integrate :SplitLSGA

48 / 86

Page 49: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Idea 2 : Integrate LS and CP

Local SearchIn theory : infiniteIn practice : number of iteration

Characteristics of a LS pathnotion of solutionOperational (computational) point of view : path =samplesmaximum length

Goal :LS orderingintegrate LS in CSP

49 / 86

Page 50: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

LS as moves on partial ordering

1p

2p

3p

4p

p5

state to another

State of LS

Function to pass from one LS

Terminates with a fixed point : local minimum, maximum number of iteration

50 / 86

Page 51: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Integrate samples for LS

A sample :Depends on a CSP

Corresponds to a LS state

an SCSP contains (LS+domain reduction) :A set of domains ;

A (list of) sample for local search (a LS path).

an σCSP contains (LS+domain reduction+split) :A set of SCSP

51 / 86

Page 52: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Theoretical model for hybridization (3)Ordering over σCSP

A solution before the end of the process, given by LS

− domain reduction,− splitting,− or LS step.

Ω3

Ω2

Ω1

Ω4

Ω5

Terminates with a fixed point : set of solutions or inconsistent SCSP

Application of a reduction :

function :

Set of SCSP

52 / 86

Page 53: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Algorithm

Always the GI algorithm

In the chaotic iteration framework

Finite domains (sets of SCSP)

Monotonic functions (LS move, domain reduction,splitting)

Decreasing functions

→ termination and computation of fixed point(solution of CP)

Practically : can stop before with a LS solution

53 / 86

Page 54: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

General process CP+LS

Sets of

GlobalLS solution

ConstraintSCSP

Fixed point

Applicationof functions

54 / 86

Page 55: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Strategies through reduction functions

Reduction / Split / LS functions

Choose a / several SCPS to apply functions

Choose a / several domains (Prop. - Split)

Tests : Random - Depth first - FC

55 / 86

Page 56: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Strategies : ratio LS-CP

Ratio of LS and CP functions applied :(red%,split%,ls%)

10% of split compared to reduction

CP alone : (90,10,0)

LS alone : (0,0,100)

LS strategy : tabu

Choose : LS, reduction, or split but keep the givenratios

56 / 86

Page 57: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Implementation

C++Generic Algorithmchoose function with percentages

57 / 86

Page 58: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Langford number 4 2cooperation area

0

100

200

300

400

500

600

700

800

10 20 30 40 50 60 70 80 90 100

Num

ber o

f ope

ratio

ns

Propagation percentage

Average

58 / 86

Page 59: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

SEND + MORE = MONEYcooperation area

200

400

600

800

1000

1200

1400

1600

10 20 30 40 50 60 70 80 90 100

Num

ber o

f ope

ratio

ns

Propagation percentage

Average

59 / 86

Page 60: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LSLS as moves on a partialordering

Integrate samples for LS

Ordering σCSP

A Generic Algorithm

Experimentation

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture works

Ranges

Problem S+M LN42 Zebra M. square GolombRate FC 70 - 80 15 - 25 60 - 70 30 - 45 30 - 40

Best range of propagation rate (α) to compute a solutionStrategy Method S+M LN42 M. square GolombRandom LS 1638 383 3328 3442

CP+LS 1408 113 892 909CP 3006 1680 1031 2170

D-First LS 1535 401 3145 3265CP+LS 396 95 814 815

CP 1515 746 936 1920FC LS 1635 393 3240 3585

CP+LS 22 192 570 622CP 530 425 736 1126

Avg. nb. of operations to compute a first solution

60 / 86

Page 61: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

61 / 86

Page 62: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Our purpose :

Use of an existing theoretical model for CSP solvingDefinition of the solving process

Integrate :SplitLSGA

62 / 86

Page 63: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Idea 3 : GA = moves in a partial ordering

p1 p2

c1 c2

p

p’

Mutation

Population Génération k

Probabilité Pm Probabilité Pc

Evaluation

Population Génération k+1

Croisement

Sélection

63 / 86

Page 64: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

GA ordering

Characteristics of a GA pathnotion of solutionmaximum lengthOperational (computational) point of view : path =generations

Here a macroscopic point of view :

1 iteration = 1 generation

64 / 86

Page 65: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Integrate generations for GA in CSPs

a generation :depends on a CSP

corresponds to a GA search state

an ogCSP contains (GA+domain reduction) :a set of domains ;

a (list of) population(s) for GA (a GA path).

an OGCSP contains (GA+domain reduction+split) :a set of ogCSPs

65 / 86

Page 66: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Theoretical model for hybridization CP+GAOrdering over OGCSPs

an optimal solution given by GA before the end of the process

− or GA.

− split

− domain reduction

Ω3

Ω2

Ω1

Ω4

Ω5

fixed point: set of solutions or inconsistency

set of ogCSP

function: Application of a reduction:

66 / 86

Page 67: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Algorithm

Always the GI algorithm

In the chaotic iteration framework

Finite domains (set of OGCSP)

Monotonic functions (GA move, domain reduction,splitting)

Decreasing functions

→ termination and computation of fixed point(solution of CP)

Practically : can stop before with an optimum for GA

67 / 86

Page 68: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Application BACP (to optimize loads ofperiods)

abc

de

jf

g

hik

f j" "fi " "bh " "

c j" "

k c" "d e" "

Lectures

a before b

ab

c

d

e j

f

g

hi

kMaxMin

Constraints

Periods

68 / 86

Page 69: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

Experimentations

On optimization problemsHere, ratios are (45,5,50)Mesure the real impact on the resolution

69 / 86

Page 70: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

BACP8

0

20

40

60

80

100

16 17 18 19 20 21 22 23 24 25

range

evaluation

propagationgenetic algorithm

split

70 / 86

Page 71: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

BACP10

0

20

40

60

80

100

12 14 16 18 20 22 24

range

evaluation

propagationgenetic algorithm

split

71 / 86

Page 72: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GAGA : moves in a partialordering

GA ordering

Integrate generations forGA in CSPs

Algorithm

Application BACP (tooptimize loads of periods

To an uniformframework CP +GA + LS

Conclusion andfuture works

BACP12

0

20

40

60

80

100

17 18 19 20 21 22 23 24 25

range

evaluation

propagationgenetic algorithm

split

72 / 86

Page 73: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

73 / 86

Page 74: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Motivation

LS + CP : a search pathGA + CP : a sequence of generationsBut : GA + CP + LS ?

=⇒ Notion of sample 6= generation=⇒ Need to consider sample and individual at the samelevel : CSP level

74 / 86

Page 75: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Search Tree

propagation

split

propagation

split

propagation

split

propagation

CSP1

CSP1’

CSP2 CSP3

CSP2’ CSP3

CSP4 CSP5 CSP3

CSP4 CSP5 CSP3’

CSP5 CSP7 CSP8CSP6’

CSP4 CSP5 CSP6 CSP7 CSP8

75 / 86

Page 76: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Example : Local Search

CSP1 CSP3 CSP4 CSP5 CSP7 CSP8CSP2 CSP6

CSP1 CSP3 CSP4 CSP5 CSP7 CSP8CSP2 CSP6

CSP1 CSP6 CSP7 CSP8 CSP9 CSP10 CSP11 CSP12

CSP1 CSP6 CSP7 CSP8 CSP9 CSP10 CSP11 CSP12

CSP1 CSP6 CSP7 CSP8 CSP9 CSP10 CSP11 CSP12

CSP1 CSP2

CSP1 CSP3 CSP4 CSP5 CSP6 CSP7 CSP8CSP2Generate new samples

Chose a sample

Generate new samples

Chose a sample

76 / 86

Page 77: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Example : Genetic algorithms

CSP3 CSP4 CSP5CSP2CSP1

CSP1 CSP2 CSP6CSP3 CSP4 CSP5

CSP1 CSP3 CSP4 CSP5CSP2 CSP6 CSP7

CSP1 CSP6 CSP7CSP3 CSP4 CSP5Selection

Crossover

Mutation

77 / 86

Page 78: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Idea 4 : break up methods

Basic componentsreducing is a search componentsplitting is a search componentgenerating a neighborhood is a search componentmoving to sample is a search component

Basic behaviourssplitting and generating a neighborhoodreducing, selecting and moving to sample

78 / 86

Page 79: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Basic fonctionsSampling S :P(〈X , C,P(D1)× · · · × P(Dn)〉)

→ P(〈X , C,P(D1)× · · · × P(Dn)〉)

φ1, . . . , φn 7→ φ1, . . . , φn, φn+1

s.t. ∃φi with φi v φn+1

Reducing R :P(〈X , C,P(D1)× · · · × P(Dn)〉)

→ P(〈X , C,P(D1)× · · · × P(Dn)〉)

φ1, . . . , φi , . . . , φn 7→ φ1, . . . , φ′i , . . . , φn

Where φ′i = ∅ or φ = 〈X , C, Di〉 and φ′ = 〈X , C, D′

i 〉 s.t.D′

i ⊆ Di .79 / 86

Page 80: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Reduction functions (1)

Domain reduction (DR)

φ1, . . . , φi , . . . , φn →DR φ1, . . . , φ′i , . . . , φn

Where DR = Rm with m > 0

Split (SP)

φ1, . . . , φi , . . . , φn →SP φ1, . . . , φ1i , . . . , φ

mi , . . . , φn

Where SP = SmR

Local Search (LS)

φ1, . . . , φi , . . . , φn →LS φ1, . . . , φ′i , . . . , φn

Where LS = SmRm−1

80 / 86

Page 81: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Reduction functions (2) Genetic Algorithms

Crossover

φ1, . . . , φn →CR φ1, . . . , φn, φn+1

Where CR = S

Mutation

φ1, . . . , φi , . . . , φn →MU φ1, . . . , φ′i , . . . , φn

Where MU = SR

Selection

φ1, . . . , φn →SE φ1, . . . , φ′n

Where SE = Rm.

81 / 86

Page 82: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LSSearch Trees

Reduction fonctions

Conclusion andfuture works

Properties

a strategy is a sequence of words∈ DR, SP, LS, SE , CR, MUis it finite sequences ?need conditions to avoid loops

82 / 86

Page 83: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture worksAssessment

Future

1 Solving CSP

2 Hybrid solving : need a framework

3 Integrate split in GI

4 Theoretical model for hybridization CP + LS

5 Theoretical model for hybridization CP + GA

6 To an uniform framework CP + GA + LS

7 Conclusion and future works

83 / 86

Page 84: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture worksAssessment

Future

Conclusion

A generic model for hybridizing complete (CP) andincomplete (LS and GA) methodsImplementation of modules working on the samestructureComplementarity of methods : hybridization

84 / 86

Page 85: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture worksAssessment

Future

Future

synergies between :complete + incomplete methods,CP + AI + OR + . . .

learning strategies, rules based system with alanguageproviding more tools in a generic environmentDesign of strategies

85 / 86

Page 86: Slides Ph D Defense Tony Lambert

Hybridization ofcomplete and

incompletemethods to solve

CSP

Tony Lambert

Solving CSP

Hybrid solving :need a framework

Integrate split in GI

Theoretical modelfor hybridizationCP + LS

Theoretical modelfor hybridizationCP + GA

To an uniformframework CP +GA + LS

Conclusion andfuture worksAssessment

Future

Hybridization of complete andincomplete methods to solve CSP

Tony Lambert

LERIA, Angers, France

LINA, Nantes, France

October 27th, 2006

Rapporteurs : François FAGES Directeur de Recherche, INRIA RocquencourtBertrand NEVEU, Ingénieur en Chef des Ponts et Chaussées, HDR

Examinateurs : Steven PRESTWICH, Associate Professor, University College CorkJin-Kao HAO, Professeur à l’Université d’Angers

Directeurs de thèse : Éric MONFROY, Professeur à l’Université de NantesFrédéric SAUBION, Professeur à l’Université d’Angers

86 / 86