46
Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan), Jean-Michel Morel (ENS Cachan) 01/10/2009 1 Image Processing on Line, Minneapolis, ONR meeting 2009 arch partially funded by ONR Grant N00014-97-1-0839

Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Embed Size (px)

Citation preview

Page 1: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1

Image Processing on LineA new way to publish?A new way to organize research in a lab?

Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan), Jean-Michel Morel (ENS Cachan)

01/10/2009

Research partially funded by ONR Grant N00014-97-1-0839

Page 2: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2

Image Processing on Line: main goal

01/10/2009

Achieve « reproducible research » and therefore:

Allow EVERYBODY to try the algorithms on their own images (including deciderswho DO NOT program)Make all results of trials accessible in a Web archive (experiment sharing)Downloadable codeGive a list of examples AND counterexamples, and explain themDescribe the algorithms carefully (pseudocode+comments)Testing independent of any platform (no code download, no system requirement…)

This is particularly adapted to image processing!

Page 3: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3

Means of the project

01/10/2009

Online servers, multicoreExecution in real/interactive time (less than 20 seconds)Research team on online web toolsSome (easy) parallel computing Reorganization of the work flow in a team

Page 4: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4

Reorganization of the work flow in a research team

01/10/2009

Math theory and first

algorithmElimination of parameters, private tests

Internal web version tested on line by the whole

team, feedback on code and theory

List of examples and

counterexamples established

Writing of the web site, green light to online

demo

Submission of paper , clear

ideas on future work

Page 5: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

501/10/2009

Lab. Web server

Internal lab workshops,

testing in group

(private) Easy building

blocks for assembling a complex chain

(video processing stereo…)

On line algorithms to contractors

(private)

Online publication (even for

« well known «

algorithms

Teaching

Four functions for a Web server

Page 6: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

601/10/2009

Algorithm website

Link to code download, C code, several

platforms

Link to on line demo

Link to publication reference or

preprint

Link to archive of

on line trials

For each algorithm: a fourfold publication

Page 7: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

701/10/2009

Current state of the site

PUBLIC ONLINE (Website and demos): http://mw.cmla.ens-cachan.fr/megawave/algo/: ASIFT : Affine Invariant Image MatchingLSD : Line Segment DetectionRandom Phase Noise : Microtexture Synthesis Cartoon+Texture Image DecompositionRetinex PDEColor Balance INTERNAL WORKSHOPS:Color contrast enhancement by PDE (three algorithms compared)http://mw.cmla.ens-cachan.fr/megawave/demo/retinex_workshop/

NL-means (on test)http://mw.cmla.ens-cachan.fr/megawave/demo/nlmeans/

Page 8: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

801/10/2009

ASIFT: affine invariant image comparison

Page 9: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

901/10/2009

Result of ASIFT: Compared with SIFT:

Page 10: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1001/10/2009

Algorithm Website

Page 11: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1101/10/2009

The website of each algorithms shows and explains the failure cases. For instance for SIFT and ASIFT, failure comparing objects with night and day illumination

Page 12: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1201/10/2009

The online demo gives also access to the online archive. More than 1550 different images have been so far tried by on line users. They are grouped in pages of 50. Here are threeexamples tried by users, on a simple box, a building and a landscape.

Page 13: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1301/10/2009

By a simple click a closer view of each experiment is available:ASIFT result : SIFT result :

Page 14: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1401/10/2009

Page 15: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1501/10/2009

Line segment detector (LSD), no parameter. More than 850 images in the archive

Page 16: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1601/10/2009

Some results

Page 17: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1701/10/2009

LSD: Some results in the online archive

Page 18: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1801/10/2009

Page 19: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

1901/10/2009

Page 20: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2001/10/2009

Page 21: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2101/10/2009

Page 22: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2201/10/2009

Page 23: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2301/10/2009

Page 24: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2401/10/2009

Page 25: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2501/10/2009

Page 26: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2601/10/2009

Page 27: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2701/10/2009

Plans

-Make a substantial database of algorithms. New ones. But many classic ones

-Pass from atoms to molecules : . Stereo (calibration, stereorectification, matching, reconstruction. Image processing (noise, blur, color, contrast: requires reliable estimates)

-Official publication? . Needs a scientific AND technical committee

. Needs a union of labs to start (right now three labs volunteer)

. Needs to fix very carefully the rules for code description, examples, etc.

. Needs €€€€€ + $$$$$

VISIT US: http://mw.cmla.ens-cachan.fr/megawave/algo/:

Page 28: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2801/10/2009

Page 29: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

2901/10/2009

Page 30: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3001/10/2009

Page 31: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3101/10/2009

Page 32: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3201/10/2009

Page 33: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3301/10/2009

Page 34: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3401/10/2009

Page 35: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3501/10/2009

Page 36: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3601/10/2009

Page 37: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3701/10/2009

Page 38: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3801/10/2009

Page 39: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

3901/10/2009

Page 40: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4001/10/2009

Page 41: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4101/10/2009

Page 42: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4201/10/2009

Page 43: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4301/10/2009

Page 44: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4401/10/2009

Page 45: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4501/10/2009

Page 46: Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan),

Image Processing on Line, Minneapolis, ONR meeting 2009

4601/10/2009