28
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands. Geneviève Cron BnF (Bibliothèque Nationale de France, French National Library) 07/05/10 Bratislava Use of digitized and OCR-ised text collections by the end users

Bratislava WS - Cron - BnF - use cases_pdf

Embed Size (px)

Citation preview

Page 1: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Geneviève CronBnF (Bibliothèque Nationale de France, French National Library)

07/05/10 Bratislava

Use of digitized and OCR-ised text collections by the end users

Page 2: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

http://gallica.bnf.fr

Over 1 000 000 documents

Gallica : BnF digital library Since 1992 OCR : since 2005

Page 3: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

OCR-ized documents on BnF Website

Over 180 000 newspapers or periodicals volumes (3 732 titles)

Over 100 000 books

07/05/10 Bratislava 3

Over 60% OCR accuracy

Average : 90 % OCR accuracy

Ocr 98% OCR word accuracy

Page 5: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Number of visits per day

Page 6: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Queries Among 1000 most frequent queries

Page 7: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Content-based queries

Page 8: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Thematic queries

Page 9: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Bibliographic based queries

Page 10: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Ocr workflows & accuracies at BnF

OCR

Manual corrections

99.9%

Manual corrections 98%

(newspaper)

[0% ,100%]

[98% ,100%]

[99,9% ,100%]

[0% , 60%]

[60% ,100%]

Image

Page 11: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Ocr Accuracy computation

[98% ,100%]

[99,9% ,100%]

[0% , 60%]

[60% ,100%]

Estimation of number of correct words / characters per page– Using service provider computation

Using ABBYY word confidence Using ABBYY doubtful word information

– Using presence in dictionary

No statistics on – Illegible areas– Numbers– Non-Iso characters– Punctuations

Page 12: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Ocr Accuracy

[98% ,100%]

[99,9% ,100%]

[0% , 60%]

[60% ,100%]

90% of BnF OCR-ized Collection

10% of BnF OCR-ized Collection

Page 13: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

31%

Page 14: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Ocr Accuracy

81 %

Page 15: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

[0% , 60%]

According to an internal study :

no USE (only NOISE)

Page 16: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Plain text indexation 3 kind of documents :

– Bib only– Bib + Table of Content– Bib + Table of Content + OCR

OCR is interesting when the words in the queries are not in the bibliographic description

– Typically, newspaper

[60% ,100%]

[98% ,100%]

[99,9% ,100%]

[60% ,100%]

Page 17: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Word highlighting http://gallica.bnf.fr/ark:/12148/bpt6k57888872.r=BRATISLAVA.f259.langFR.hl

[98% ,100%]

[99,9% ,100%]

[60% ,100%]

ALTO (or ...) is required to describe the place of the word in the page

Page 18: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Press browse (most consulted documents) Search for « Bratislava » in the OCR-ized press

http://gallica.bnf.fr/ark:/12148/bpt6k4435907.zoom.r=bratislava.f1.langEN

[98% ,100%]

Page 19: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Genealogy Or history of personnal locality

– about 1/3 of queries – Would have no interest whitout OCR since information is not in the notice

BnF has (Commercial) Partnerships– Ancestry– …

[98% ,100%]

[99,9% ,100%]

Page 21: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

http://fr.wikisource.org/wiki/Page:Anomyme_-_Raoul_de_Cambrai.djvu/82

Page 22: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Quotations in research papers

[98% ,100%]

[99,9% ,100%]

“[…] Now, when these medicines were required, the river was swollen and so turbulent that its upward navigation was almost impracticable. At length even the task of burying the dead was more than the living could perform, and the bodies were tossed into the stream, or left for beasts of prey, and for the gallinazos—those dreadful carrion-birds, which do not always wait for death before they begin their work. Five months the English persisted in what may be called this war against nature; they then left a few men, who seemed proof against the climate, to retain the castle till the Spaniards should choose, when the fit season arrived, to retake it and make them prisoners.”

http://gallica.bnf.fr/ark:/12148/bpt6k5706366b.texteBrut

Page 23: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Text to speech conversion

http://gallica.bnf.fr/ark:/12148/bpt6k54789860.vocal.f16.langFR

[99,9% ,100%]

Page 24: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

E Pubs

[99,9% ,100%]

BnF has only 3 epubs yet will have about 1000 at the end of the year Is thinking at ALTO to Epub conversion on

its high quality material but work is difficult due to book structure (margins, footnotes)

Page 26: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Tel+ indexation http://www.theeuropeanlibrary.org/portal/organisation/cooperation/telplus/

http://search.theeuropeanlibrary.org/portal/en/index.html?lang=en&pub=&bid=a4d79516-5b46-102a-81b6-ceee3e6c61a2&q=%22%22

[99,9% ,100%]

Page 27: Bratislava WS - Cron - BnF - use cases_pdf

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Learning datasets Image + Its Text Conversion

– Learning datasets for OCR– Evaluation sets for OCR related projects

[99,9% ,100%]