16th International Seminar CASLIN 2009 1 Open Access and Institutional Repositories from local...

Preview:

Citation preview

16th International Seminar CASLIN 2009

1

Open Access and Institutional

Repositories from local initiatives to global strategies

Friedrich Summann(friedrich.summann@uni-bielefeld.de)

Bielefeld University Library

16Th International Seminar CASLIN 2009

16th International Seminar CASLIN 2009

2

Overview

Local initiatives - Open Access strategy and implementationNational Projects- Funded projects (DFG, German Science Foundation)International Projects- BASE, DRIVER, PEER

16th International Seminar CASLIN 2009

3

Open Access in Bielefeld University

• Archiving Electronic Dissertations (1996 -)

• First Repository System (2004)

• University Resolution for Open Access Publishing (2005)

• Establishing Postprint Server (2006 -)

• CIO for Scientific Publishing (2006 -)

16th International Seminar CASLIN 2009

4

UNIBI repositories:

• BieSON (Dissertations, 2004)

(1121 docs)

• BieTAS (Distributed material, 2005)

(330 docs)

• BieColl (Proceedings, 2007) (2530)

• BiPrints (Scientific Output, 2008) (2367)

16th International Seminar CASLIN 2009

5

BieSOn

16th International Seminar CASLIN 2009

6

BieTAS (Bielefeld Text Archiv Server)

16th International Seminar CASLIN 2009

7

BieColl (Bielefeld eCollections)

16th International Seminar CASLIN 2009

8

BiPrints

16th International Seminar CASLIN 2009

9

Visibility of Repositories

16th International Seminar CASLIN 2009

10

Current Library and University Activities

• BioMed Central Contract• DINI partner• Electronic Journal Publishing

– DIPP NRW– OJS installation

• Cooperation Research Database - Repository

16th International Seminar CASLIN 2009

11

DIPP journal frontpage for UNIBI journal

16th International Seminar CASLIN 2009

12

University Research Database (FODA)

16th International Seminar CASLIN 2009

13

National Projects• Open-Access.net• OPUS4• PubLister• Automatic Classification Extraction

Funded by the DFG (Deutsche Forschungsgemeinschaft,German Science Foundation)

16th International Seminar CASLIN 2009

14

Open-Access.net

16th International Seminar CASLIN 2009

15

PubLister

DFG Project (18 months)Goals:• Integration of scientists personal publications

lists into the university publishing process • Extracting metadata• Storing the postprint (repository)• Producing a university bibliography• Organizational and technical framework for the

creation of publication lists

16th International Seminar CASLIN 2009

16

Automatic Enrichment of OAI Metadata

DFG-Project (German Science Foundation)Duration: 24 months

Partners:• Bielefeld University Library (coordination)• Bielefeld University, Computer Linguistics Department• Leipzig University, Institute for Computer Science

16th International Seminar CASLIN 2009

17

Automatic Enrichment of OAI-Metadata

Current status of Classification Information in OAI metadata:

• Only 1 % with classification codes• Different classification systems• Depth is not sufficient

16th International Seminar CASLIN 2009

18

Automatic Enrichment of OAI-Metadata

Work packages

• Extraction of Classification codes and related information from OAI metadata

• Building a knowledge base • Structured text mining• Delivering DDC codes for documents• Designing an open interface• Integrating into Services (BASE, DRIVER)

16th International Seminar CASLIN 2009

19

Extraction of Classification codes and related information from OAI metadata<record> <ddc>370</ddc> <subject>Fremdsprachenlernen</subject> <subject>Deutschunterricht</subject> <subject>Ausl<E4>nder</subject> <subject>Lerner-Uptake</subject> <subject>Kurzzeitiger Fremdsprachenerwerb</subject> <subject>Education</subject> <language>ger</language> <link>http://bieson.ub.uni-bielefeld.de/volltexte/2002/97/pdf/0_titel.pdf</link> <link>http://bieson.ub.uni-bielefeld.de/volltexte/2002/97/pdf/1_inhalt.pdf</link> <link>http://bieson.ub.uni-bielefeld.de/volltexte/2002/97/pdf/2_diss.pdf</link> <link>http://bieson.ub.uni- bielefeld.de/volltexte/2002/97/pdf/3_versicherung.pdf </link></record>

16th International Seminar CASLIN 2009

20

Automatic Enrichment of OAI-Metadata

Work packages

• Extraction of Classification codes and related information from OAI metadata

• Building a knowledge base • Structured text mining• Delivering DDC codes for documents• Designing an open interface• Integrating into Services (BASE, DRIVER)

16th International Seminar CASLIN 2009

21

OPUS4

• 8 Partners (libraries and library networks)• DFG project (1.7.08 – 30.6.09)• Modernized and enhanced software release

Bielefeld UL work packages• DRIVER Interoperability• Collections• CRIS – IR integration

16th International Seminar CASLIN 2009

22

International Projects

• BASE (Bielefeld Academic Search Engine)

• DRIVER

• PEER

16th International Seminar CASLIN 2009

23

BASE (Bielefeld Academic Search Engine)

• Commercial software (FAST backend)

• Local server farm

• PHP frontend (Bielefeld UL)

• OAI Harvesting / Web Crawling

• Few library people

• Content worldwide

• OA-focused

16th International Seminar CASLIN 2009

24

1921 Repositories –> 22,000,000 metadata records Harvested/analyzed

1260 Repositories –>19,700,000 aggregated/indexed

BASE (Bielefeld Academic Search Engine)

16th International Seminar CASLIN 2009

25

BASE – Advanced Search

16th International Seminar CASLIN 2009

26

BASE – Search features

• Truncation• Search History• Drilldown• Linguistic Search Features

– Thesauri– Lemmatizing

• DDC Browsing• Sorting• Google Scholar Link

16th International Seminar CASLIN 2009

27

BASE – Result Display

16th International Seminar CASLIN 2009

28

BASE – Common interface

Currently used by

• Metager (German meta search engine)

• KVK (Karlsruhe Virtual Catalogue)

• Digital Library NRW (metasearch portal)

• Local Library Catalogue

16th International Seminar CASLIN 2009

29

BASE – OPAC integration

16th International Seminar CASLIN 2009

30

DRIVER - the Project (1)

DRIVERI: 1.6.2006 – 30.11.2007

• Building a Testbed for a Future Knowledge Infrastructure in Europe based on Scientific Publications in Repositories

DRIVER =Digital Repository Infrastructure Vision for European Research

16th International Seminar CASLIN 2009

31

DRIVER - the Project (2)

DRIVERII: 1.12.2007- 30.11.2009

• Establishing a Productive Infrastructure

• Expansion of Geographic Coverage

• Extension of Metadata and Data Formats

• Extension of Services

16th International Seminar CASLIN 2009

32

DRIVER – Partners

Phase 1• 10 Partners from 8 Countries • (D, GB, IT, F, NL, B, PL, GR)

Phase 2• 3 additional project partners (PT, DK, SI)• Additional partners (S, N, FI, LT, ES, IRL)

• Co-ordination: Univ. Athens, SUB Göttingen

16th International Seminar CASLIN 2009

33

DRIVER – Bielefeld UL

• Technical Activities (Technical Group)– Harvesting/Aggregation– Storing– Indexing

• Network Activities– Guidelines Definition– Harvesting/Aggregation (Feedback)

• OPUS4 Project (DRIVER Interoperability)

16th International Seminar CASLIN 2009

34

DRIVER: Repository Infrastructure • Phase 1:

– 51-Testbed Repositories (DINI, DARE, SHERPA, CNRS, Univ. Gent)

• Phase 2: – Plus further DRIVERI countries– DRIVERII countries– Other European Countries

16th International Seminar CASLIN 2009

35

DRIVER – Core aspects

• Open source software• SOA structure• Based on OAI harvesting• Network of partners• Academic content from Europe• OA documents only

16th International Seminar CASLIN 2009

36

DRIVER Repository Workflow

• Registration of Repository Managers

• Proposals from Country Correspondents

• Observing Registries

• Analysis/Validation

• Harvesting/Aggregating/Indexierung

• Activation

16th International Seminar CASLIN 2009

37

DRIVER: OAI AggregationGoal: Data Quality Improvement

• Normalisation (Vocabulary-based)– dc:type– dc:date– dc:language

• Language Detection• Extraction of Document Link• Rules Definition• Scripting

16th International Seminar CASLIN 2009

38

Data Quality (Example dc:type)

Text - 2597764text - 2540080TEXT - 1128327Dataset - 580448Image - 522643image - 514585Electronic Thesis or Dissertation -

366783Tese ou Dissertacao Eletronica -

357567article - 345093Article - 337314Artikel - 310858Other - 219331still image - 212178Rezension - 198773preprint - 191784NonPeerReviewed - 173643

NULL - 8082Clippings<br>Text<br> - 5004 This record contains content - 1473Dark Item - 1145

Photographs; Mosaics; - 11 photographic print mounted on cardboard: b&w; 22 x 16 in. - 180534 - 1Section V Flow Control - 1Acrylic on board: 63 x 114 cm. - 179508 - 1Colored graphite on paper: 47 x 63 cm. - 1texts, vocabulary ('stories, monologues, word list' - 115121 - 1

15,542,177 Entries - 15214 Values

16th International Seminar CASLIN 2009

39

DRIVER - Aggregator (1)

16th International Seminar CASLIN 2009

40

DRIVER – Aggregator (2)

16th International Seminar CASLIN 2009

41

DRIVER – Aggregator (3)

16th International Seminar CASLIN 2009

42

DRIVER Guidelineshttp://www.driver-support.eu/documents/DRIVER_Guidelines_v2_Final_2008-11-13.pdf

16th International Seminar CASLIN 2009

43

DRIVER Guidelines and OAI usage

• OAI-PMH : Protocol Requirements– Stability, Protocol compliance, XML validity– Incremental Harvesting

• OAI-PMH: Additional Requirements– Deleting strategy – Set für OA-Dokumente, Fulltext link– Batch size

• DRIVER DC Metadata Requirements– Content Recommendations (creator, subject,

source)– Standardized Contents (type, language, date)

16th International Seminar CASLIN 2009

44

DRIVER – Validator tool

16th International Seminar CASLIN 2009

45

DRIVER – Aggregational Results

16th International Seminar CASLIN 2009

46

DRIVER network of academic repositories

16th International Seminar CASLIN 2009

47

DRIVER – Support Network

16th International Seminar CASLIN 2009

48

http://www.driver-repository.eu/

16th International Seminar CASLIN 2009

49

PEER =

Publishing and the Ecology of European Research

Focus: relationship between publishers, repositories and the research community

evaluate the bi-directional influence of the different strategies of publications

(publishers journal, open access publication)

16th International Seminar CASLIN 2009

50

PEER (2)

• More than 50,000 European acceptedmanuscripts from up to 300 journals will become available for archiving within repositories

• BiPrints will serve as OA repository

• Comparing access log files

16th International Seminar CASLIN 2009

51

Conclusion

• All these listed activities are related to open access publishing

• There are strong bi-directional impactsbetween each other

• It makes no difference on which level• Integration will produce benefit for

scientists and end-users

16th International Seminar CASLIN 2009

52

• Thank You !