WorldWideScience.orgWorldWideScience.org

Providing Global Access to World Science: Providing Global Access to World Science: Overcoming Standards Challenges Through Overcoming Standards Challenges Through

Federated SearchFederated Search CODATA 2008 Kyiv, UkraineCODATA 2008 Kyiv, Ukraine

Thomas F. LahrThomas F. Lahr

US Geological Survey, Reston, VA USAUS Geological Survey, Reston, VA USA

Co-Chair, US Science.gov AllianceCo-Chair, US Science.gov Alliance

Alternate US Representative, WorldWideScience.org AllianceAlternate US Representative, WorldWideScience.org Alliance

Why WorldWideScience.org?Why WorldWideScience.org?

There is a need to find national scientific and There is a need to find national scientific and technical information quickly and easily, but technical information quickly and easily, but information is dispersed across thousands of information is dispersed across thousands of

web sites (“Surface Web”) in addition to being web sites (“Surface Web”) in addition to being found within databases or portals (“Deep found within databases or portals (“Deep

Web”).Web”).

Surface Web vs Deep WebSurface Web vs Deep Web 20052005

•Size: Estimated to be 5 to 500 Size: Estimated to be 5 to 500 times larger (BrightPlanet) times larger (BrightPlanet)

•Dynamically generated content Dynamically generated content that lives inside databasesthat lives inside databases

•High-quality, managed, subject-High-quality, managed, subject-specific contentspecific content

•Growing faster than surface web Growing faster than surface web (BrightPlanet)(BrightPlanet)

•Size: Estimated to be 8+ billion Size: Estimated to be 8+ billion (Google) to 45 billion (About.com) (Google) to 45 billion (About.com) web pagesweb pages

•Static, crawlable web pagesStatic, crawlable web pages

•Large amounts of unfiltered Large amounts of unfiltered informationinformation

•Limited to what is easily found Limited to what is easily found by search enginesby search engines

National Science Portals Collaboration National Science Portals Collaboration and Coordinationand Coordination

2004 Vascoda (Germany) and Science.gov (US) and KISTI 2004 Vascoda (Germany) and Science.gov (US) and KISTI (Korea) Discussions and Meetings (Korea) Discussions and Meetings

2005 and 2006 IFLA Norway Korea – Ad Hoc Meetings of 2005 and 2006 IFLA Norway Korea – Ad Hoc Meetings of National Science Portals (hosted by GIOPS)National Science Portals (hosted by GIOPS)

June 2006 ICSTI Meeting Washington DC June 2006 ICSTI Meeting Washington DC Frierson - “National Science Portals: New Potential Frierson - “National Science Portals: New Potential

Partnerships for Global Discovery”Partnerships for Global Discovery” Warnick - “Science.world” Portal Warnick - “Science.world” Portal ICSTI Science Portals Forum ProposedICSTI Science Portals Forum Proposed

ICSTI Science Portals Forum ProposalICSTI Science Portals Forum Proposal

1.1. Organize and host 2 meetingsOrganize and host 2 meetings2.2. Create a summary matrix comparing national Create a summary matrix comparing national

and international science portals to identify and international science portals to identify key characteristics and issues key characteristics and issues

3.3. Mobilize a proof of concept trial for a “cross Mobilize a proof of concept trial for a “cross science” portals search science” portals search

4.4. Develop a plan of actionDevelop a plan of action

ICSTI Immediately funded 1 and 2ICSTI Immediately funded 1 and 2

1. Organize and host 2 meetings1. Organize and host 2 meetings

January 2007 - ICSTI winter meeting in LondonJanuary 2007 - ICSTI winter meeting in London

June 2007 - ICSTI meeting NancyJune 2007 - ICSTI meeting Nancy

2. Create a summary matrix comparing national 2. Create a summary matrix comparing national and international science portals to identify key and international science portals to identify key characteristics and issues characteristics and issues

What is a portal?What is a portal?How to define scope and coverageHow to define scope and coverageIntellectual property rights managementIntellectual property rights management Search techniques- browse taxonomies, site Search techniques- browse taxonomies, site searching, deep web, metadata, data, searching, deep web, metadata, data, publicationspublicationsLanguagesLanguages

US DOE/BL Agreement US DOE/BL Agreement

In January 2007 the US Department of In January 2007 the US Department of Energy and the British Library agreed to Energy and the British Library agreed to

partner to develop a global science partner to develop a global science gateway to accelerate scientific discovery gateway to accelerate scientific discovery

WorldWideScience.org WorldWideScience.org

June 2007 demonstration June 2007 demonstration 12 databases/10 countries12 databases/10 countries Invited others to join in developing Invited others to join in developing

governance documents-Feb 2008governance documents-Feb 2008

How Does the Worldwide Science Gateway work?

The approach is to capitalize on existing “federated search” The approach is to capitalize on existing “federated search” technology to search collections of science information technology to search collections of science information distributed across the globe. distributed across the globe.

This enables much-needed access to both prominent as well as This enables much-needed access to both prominent as well as smaller, less well-known sources of highly valuable science.smaller, less well-known sources of highly valuable science.

Users simply submit a single query into the Users simply submit a single query into the WorldWideScience.org search engine to launch simultaneous WorldWideScience.org search engine to launch simultaneous searching of the databases and portals of participating nations. searching of the databases and portals of participating nations.

Results are returned in relevance-ranked order.Results are returned in relevance-ranked order.

WorldWideScience Alliance WorldWideScience Alliance

June 12, 2008 Seoul, Korea signing June 12, 2008 Seoul, Korea signing ceremony for this multilateral alliance ceremony for this multilateral alliance

11 founding member organizations11 founding member organizations Representing 38 countriesRepresenting 38 countries ICSTI is sponsorICSTI is sponsor

Current National Partners in Current National Partners in WorldWideScience.orgWorldWideScience.org

WWS.org Databases and PortalsWWS.org Databases and Portals

African Journals OnlineAfrican Journals OnlineAustralian Antarctic Data Centre Australian Antarctic Data Centre Bangladesh Journals Online Bangladesh Journals Online (BanglaJOL) (BanglaJOL) Canada Institute for Scientific and Canada Institute for Scientific and Technical Information Technical Information Catalogue of the TIB, German Catalogue of the TIB, German National Library of Science & National Library of Science & Technolgy (TIBKat) Technolgy (TIBKat) CSIR Research Space (South Africa) CSIR Research Space (South Africa) Czech Academy of Sciences Czech Academy of Sciences Repository  Repository  Defence Research and Development Defence Research and Development Canada (Canada) Canada (Canada) DEFF Global E Prints (Denmark) DEFF Global E Prints (Denmark) DEFF Research Database (Denmark) DEFF Research Database (Denmark) Digital Repository Service at National Digital Repository Service at National Institute of Oceanography (India) Institute of Oceanography (India) Directory of Open Access Journals Directory of Open Access Journals (Sweden) (Sweden) Electronic Table of Contents (ETOC) Electronic Table of Contents (ETOC) (United Kingdom) (United Kingdom) Energy Technology Data Exchange Energy Technology Data Exchange (ETDEWEB) (ETDEWEB) Indian Academy of Sciences Indian Academy of Sciences Indian Institute of Science EprintsIndian Institute of Science Eprints

Indian Institute of Science Theses & Indian Institute of Science Theses & Dissertations Dissertations Indian Medlars Centre Indian Medlars Centre INIST (France)INIST (France)J-EAST (Japan) J-EAST (Japan) J-STAGE (Japan) J-STAGE (Japan) J-STORE (Japan) J-STORE (Japan) http://www.journalarchive.jst.go.jp/english/top_ehttp://www.journalarchive.jst.go.jp/english/top_en.php n.php KoreaScience KoreaScience NARCIS (Netherlands) NARCIS (Netherlands) National Library of the Czech Republic National Library of the Czech Republic Manuscriptorium   Manuscriptorium   Nepal Journals Online (NepJOL) Nepal Journals Online (NepJOL) Norwegian Open Research Archives (NORA) Norwegian Open Research Archives (NORA) Philippines Journals Online (PhilJOL) Philippines Journals Online (PhilJOL) Science.gov (United States) Science.gov (United States) Scientific Electronic Library Online (Argentina, Scientific Electronic Library Online (Argentina, Brazil, Chile, Colombia, Cuba, Mexico, Portugal, Brazil, Chile, Colombia, Cuba, Mexico, Portugal, Spain, Venezuela) Spain, Venezuela) Transactions and Proceedings of the Royal Transactions and Proceedings of the Royal Society of New Zealand 1868-1961 (New Society of New Zealand 1868-1961 (New Zealand) Zealand) UK PubMed Central (United Kingdom) UK PubMed Central (United Kingdom) Vascoda (Germany) Vascoda (Germany) Vietnam Journals Online (VJOL) Vietnam Journals Online (VJOL) VTT Technical Research Centre of Finland-VTT Technical Research Centre of Finland-Publications (Finland) Publications (Finland) VTT Technical Research Centre of Finland-VTT Technical Research Centre of Finland-Research (Finland) Research (Finland)

WorldWideScience.orgWorldWideScience.org

A rapidly growing gateway toA rapidly growing gateway to

scientific and technical information scientific and technical information

databases and portals around the worlddatabases and portals around the world

Thank You!Thank You!