Image Processing on Line A new way to publish? A new way to organize research in a lab? Jérôme...

Preview:

Citation preview

Image Processing on Line, Minneapolis, ONR meeting 2009

1

Image Processing on LineA new way to publish?A new way to organize research in a lab?

Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan), Jean-Michel Morel (ENS Cachan)

01/10/2009

Research partially funded by ONR Grant N00014-97-1-0839

Image Processing on Line, Minneapolis, ONR meeting 2009

2

Image Processing on Line: main goal

01/10/2009

Achieve « reproducible research » and therefore:

Allow EVERYBODY to try the algorithms on their own images (including deciderswho DO NOT program)Make all results of trials accessible in a Web archive (experiment sharing)Downloadable codeGive a list of examples AND counterexamples, and explain themDescribe the algorithms carefully (pseudocode+comments)Testing independent of any platform (no code download, no system requirement…)

This is particularly adapted to image processing!

Image Processing on Line, Minneapolis, ONR meeting 2009

3

Means of the project

01/10/2009

Online servers, multicoreExecution in real/interactive time (less than 20 seconds)Research team on online web toolsSome (easy) parallel computing Reorganization of the work flow in a team

Image Processing on Line, Minneapolis, ONR meeting 2009

4

Reorganization of the work flow in a research team

01/10/2009

Math theory and first

algorithmElimination of parameters, private tests

Internal web version tested on line by the whole

team, feedback on code and theory

List of examples and

counterexamples established

Writing of the web site, green light to online

demo

Submission of paper , clear

ideas on future work

Image Processing on Line, Minneapolis, ONR meeting 2009

501/10/2009

Lab. Web server

Internal lab workshops,

testing in group

(private) Easy building

blocks for assembling a complex chain

(video processing stereo…)

On line algorithms to contractors

(private)

Online publication (even for

« well known «

algorithms

Teaching

Four functions for a Web server

Image Processing on Line, Minneapolis, ONR meeting 2009

601/10/2009

Algorithm website

Link to code download, C code, several

platforms

Link to on line demo

Link to publication reference or

preprint

Link to archive of

on line trials

For each algorithm: a fourfold publication

Image Processing on Line, Minneapolis, ONR meeting 2009

701/10/2009

Current state of the site

PUBLIC ONLINE (Website and demos): http://mw.cmla.ens-cachan.fr/megawave/algo/: ASIFT : Affine Invariant Image MatchingLSD : Line Segment DetectionRandom Phase Noise : Microtexture Synthesis Cartoon+Texture Image DecompositionRetinex PDEColor Balance INTERNAL WORKSHOPS:Color contrast enhancement by PDE (three algorithms compared)http://mw.cmla.ens-cachan.fr/megawave/demo/retinex_workshop/

NL-means (on test)http://mw.cmla.ens-cachan.fr/megawave/demo/nlmeans/

Image Processing on Line, Minneapolis, ONR meeting 2009

801/10/2009

ASIFT: affine invariant image comparison

Image Processing on Line, Minneapolis, ONR meeting 2009

901/10/2009

Result of ASIFT: Compared with SIFT:

Image Processing on Line, Minneapolis, ONR meeting 2009

1001/10/2009

Algorithm Website

Image Processing on Line, Minneapolis, ONR meeting 2009

1101/10/2009

The website of each algorithms shows and explains the failure cases. For instance for SIFT and ASIFT, failure comparing objects with night and day illumination

Image Processing on Line, Minneapolis, ONR meeting 2009

1201/10/2009

The online demo gives also access to the online archive. More than 1550 different images have been so far tried by on line users. They are grouped in pages of 50. Here are threeexamples tried by users, on a simple box, a building and a landscape.

Image Processing on Line, Minneapolis, ONR meeting 2009

1301/10/2009

By a simple click a closer view of each experiment is available:ASIFT result : SIFT result :

Image Processing on Line, Minneapolis, ONR meeting 2009

1401/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

1501/10/2009

Line segment detector (LSD), no parameter. More than 850 images in the archive

Image Processing on Line, Minneapolis, ONR meeting 2009

1601/10/2009

Some results

Image Processing on Line, Minneapolis, ONR meeting 2009

1701/10/2009

LSD: Some results in the online archive

Image Processing on Line, Minneapolis, ONR meeting 2009

1801/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

1901/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2001/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2101/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2201/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2301/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2401/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2501/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2601/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2701/10/2009

Plans

-Make a substantial database of algorithms. New ones. But many classic ones

-Pass from atoms to molecules : . Stereo (calibration, stereorectification, matching, reconstruction. Image processing (noise, blur, color, contrast: requires reliable estimates)

-Official publication? . Needs a scientific AND technical committee

. Needs a union of labs to start (right now three labs volunteer)

. Needs to fix very carefully the rules for code description, examples, etc.

. Needs €€€€€ + $$$$$

VISIT US: http://mw.cmla.ens-cachan.fr/megawave/algo/:

Image Processing on Line, Minneapolis, ONR meeting 2009

2801/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

2901/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3001/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3101/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3201/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3301/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3401/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3501/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3601/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3701/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3801/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

3901/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4001/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4101/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4201/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4301/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4401/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4501/10/2009

Image Processing on Line, Minneapolis, ONR meeting 2009

4601/10/2009

Recommended