Upload
impact-centre-of-competence
View
695
Download
3
Tags:
Embed Size (px)
Citation preview
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Geneviève CronBnF (Bibliothèque Nationale de France, French National Library)
07/05/10 Bratislava
Use of digitized and OCR-ised text collections by the end users
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
http://gallica.bnf.fr
Over 1 000 000 documents
Gallica : BnF digital library Since 1992 OCR : since 2005
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
OCR-ized documents on BnF Website
Over 180 000 newspapers or periodicals volumes (3 732 titles)
Over 100 000 books
07/05/10 Bratislava 3
Over 60% OCR accuracy
Average : 90 % OCR accuracy
Ocr 98% OCR word accuracy
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Users Internet Readers
– Readers in the library – Mobile Readers
Handicapped
Europe 86%– France : 70%
Non readers– OCR related works
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Number of visits per day
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Queries Among 1000 most frequent queries
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Content-based queries
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Thematic queries
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Bibliographic based queries
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr workflows & accuracies at BnF
OCR
Manual corrections
99.9%
Manual corrections 98%
(newspaper)
[0% ,100%]
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]
Image
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr Accuracy computation
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]
Estimation of number of correct words / characters per page– Using service provider computation
Using ABBYY word confidence Using ABBYY doubtful word information
– Using presence in dictionary
No statistics on – Illegible areas– Numbers– Non-Iso characters– Punctuations
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr Accuracy
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]
90% of BnF OCR-ized Collection
10% of BnF OCR-ized Collection
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
31%
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr Accuracy
81 %
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
[0% , 60%]
According to an internal study :
no USE (only NOISE)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Plain text indexation 3 kind of documents :
– Bib only– Bib + Table of Content– Bib + Table of Content + OCR
OCR is interesting when the words in the queries are not in the bibliographic description
– Typically, newspaper
[60% ,100%]
[98% ,100%]
[99,9% ,100%]
[60% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Word highlighting http://gallica.bnf.fr/ark:/12148/bpt6k57888872.r=BRATISLAVA.f259.langFR.hl
[98% ,100%]
[99,9% ,100%]
[60% ,100%]
ALTO (or ...) is required to describe the place of the word in the page
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Press browse (most consulted documents) Search for « Bratislava » in the OCR-ized press
http://gallica.bnf.fr/ark:/12148/bpt6k4435907.zoom.r=bratislava.f1.langEN
[98% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Genealogy Or history of personnal locality
– about 1/3 of queries – Would have no interest whitout OCR since information is not in the notice
BnF has (Commercial) Partnerships– Ancestry– …
[98% ,100%]
[99,9% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Collaborative correction BnF signed an agreement with Wikimedia to provide 1400
books of various quality and period – Anyone can correct OCR
100 % accuracy
– http://fr.wikisource.org/wiki/Raoul_de_Cambrai/Texte_entier
[60% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
http://fr.wikisource.org/wiki/Page:Anomyme_-_Raoul_de_Cambrai.djvu/82
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Quotations in research papers
[98% ,100%]
[99,9% ,100%]
“[…] Now, when these medicines were required, the river was swollen and so turbulent that its upward navigation was almost impracticable. At length even the task of burying the dead was more than the living could perform, and the bodies were tossed into the stream, or left for beasts of prey, and for the gallinazos—those dreadful carrion-birds, which do not always wait for death before they begin their work. Five months the English persisted in what may be called this war against nature; they then left a few men, who seemed proof against the climate, to retain the castle till the Spaniards should choose, when the fit season arrived, to retake it and make them prisoners.”
http://gallica.bnf.fr/ark:/12148/bpt6k5706366b.texteBrut
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Text to speech conversion
http://gallica.bnf.fr/ark:/12148/bpt6k54789860.vocal.f16.langFR
[99,9% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
E Pubs
[99,9% ,100%]
BnF has only 3 epubs yet will have about 1000 at the end of the year Is thinking at ALTO to Epub conversion on
its high quality material but work is difficult due to book structure (margins, footnotes)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Epub difficulties : book structuration
http://gallica.bnf.fr/ark:/12148/bpt6k73555s.textePage.f70.langFR
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Tel+ indexation http://www.theeuropeanlibrary.org/portal/organisation/cooperation/telplus/
http://search.theeuropeanlibrary.org/portal/en/index.html?lang=en&pub=&bid=a4d79516-5b46-102a-81b6-ceee3e6c61a2&q=%22%22
[99,9% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Learning datasets Image + Its Text Conversion
– Learning datasets for OCR– Evaluation sets for OCR related projects
[99,9% ,100%]
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
To conclude
Uses are highly depending on – OCR accuracy– Format
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]