Image Processing on Line, Minneapolis, ONR meeting 2009
1
Image Processing on LineA new way to publish?A new way to organize research in a lab?
Jérôme Darbon (UCLA and ENS Cachan), Nicolas Limare (ENS Cachan), Jean-Michel Morel (ENS Cachan)
01/10/2009
Research partially funded by ONR Grant N00014-97-1-0839
Image Processing on Line, Minneapolis, ONR meeting 2009
2
Image Processing on Line: main goal
01/10/2009
Achieve « reproducible research » and therefore:
Allow EVERYBODY to try the algorithms on their own images (including deciderswho DO NOT program)Make all results of trials accessible in a Web archive (experiment sharing)Downloadable codeGive a list of examples AND counterexamples, and explain themDescribe the algorithms carefully (pseudocode+comments)Testing independent of any platform (no code download, no system requirement…)
This is particularly adapted to image processing!
Image Processing on Line, Minneapolis, ONR meeting 2009
3
Means of the project
01/10/2009
Online servers, multicoreExecution in real/interactive time (less than 20 seconds)Research team on online web toolsSome (easy) parallel computing Reorganization of the work flow in a team
Image Processing on Line, Minneapolis, ONR meeting 2009
4
Reorganization of the work flow in a research team
01/10/2009
Math theory and first
algorithmElimination of parameters, private tests
Internal web version tested on line by the whole
team, feedback on code and theory
List of examples and
counterexamples established
Writing of the web site, green light to online
demo
Submission of paper , clear
ideas on future work
Image Processing on Line, Minneapolis, ONR meeting 2009
501/10/2009
Lab. Web server
Internal lab workshops,
testing in group
(private) Easy building
blocks for assembling a complex chain
(video processing stereo…)
On line algorithms to contractors
(private)
Online publication (even for
« well known «
algorithms
Teaching
Four functions for a Web server
Image Processing on Line, Minneapolis, ONR meeting 2009
601/10/2009
Algorithm website
Link to code download, C code, several
platforms
Link to on line demo
Link to publication reference or
preprint
Link to archive of
on line trials
For each algorithm: a fourfold publication
Image Processing on Line, Minneapolis, ONR meeting 2009
701/10/2009
Current state of the site
PUBLIC ONLINE (Website and demos): http://mw.cmla.ens-cachan.fr/megawave/algo/: ASIFT : Affine Invariant Image MatchingLSD : Line Segment DetectionRandom Phase Noise : Microtexture Synthesis Cartoon+Texture Image DecompositionRetinex PDEColor Balance INTERNAL WORKSHOPS:Color contrast enhancement by PDE (three algorithms compared)http://mw.cmla.ens-cachan.fr/megawave/demo/retinex_workshop/
NL-means (on test)http://mw.cmla.ens-cachan.fr/megawave/demo/nlmeans/
Image Processing on Line, Minneapolis, ONR meeting 2009
801/10/2009
ASIFT: affine invariant image comparison
Image Processing on Line, Minneapolis, ONR meeting 2009
901/10/2009
Result of ASIFT: Compared with SIFT:
Image Processing on Line, Minneapolis, ONR meeting 2009
1001/10/2009
Algorithm Website
Image Processing on Line, Minneapolis, ONR meeting 2009
1101/10/2009
The website of each algorithms shows and explains the failure cases. For instance for SIFT and ASIFT, failure comparing objects with night and day illumination
Image Processing on Line, Minneapolis, ONR meeting 2009
1201/10/2009
The online demo gives also access to the online archive. More than 1550 different images have been so far tried by on line users. They are grouped in pages of 50. Here are threeexamples tried by users, on a simple box, a building and a landscape.
Image Processing on Line, Minneapolis, ONR meeting 2009
1301/10/2009
By a simple click a closer view of each experiment is available:ASIFT result : SIFT result :
Image Processing on Line, Minneapolis, ONR meeting 2009
1401/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
1501/10/2009
Line segment detector (LSD), no parameter. More than 850 images in the archive
Image Processing on Line, Minneapolis, ONR meeting 2009
1601/10/2009
Some results
Image Processing on Line, Minneapolis, ONR meeting 2009
1701/10/2009
LSD: Some results in the online archive
Image Processing on Line, Minneapolis, ONR meeting 2009
1801/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
1901/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2001/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2101/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2201/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2301/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2401/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2501/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2601/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2701/10/2009
Plans
-Make a substantial database of algorithms. New ones. But many classic ones
-Pass from atoms to molecules : . Stereo (calibration, stereorectification, matching, reconstruction. Image processing (noise, blur, color, contrast: requires reliable estimates)
-Official publication? . Needs a scientific AND technical committee
. Needs a union of labs to start (right now three labs volunteer)
. Needs to fix very carefully the rules for code description, examples, etc.
. Needs €€€€€ + $$$$$
VISIT US: http://mw.cmla.ens-cachan.fr/megawave/algo/:
Image Processing on Line, Minneapolis, ONR meeting 2009
2801/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
2901/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3001/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3101/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3201/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3301/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3401/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3501/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3601/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3701/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3801/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
3901/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4001/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4101/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4201/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4301/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4401/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4501/10/2009
Image Processing on Line, Minneapolis, ONR meeting 2009
4601/10/2009