TRANS-JAI€¦ · TRANS JAI Messaging, Protocols and Data-Interchange The TRANS-JAI XML message format for Dynamic Contents The EU Institution’s RSS 2.0 feed. RSS is an XML-based

1

TRANS-JAI... improving the transparency of the law making process in the Freedom Security

and Justice (FSJ) domain of the European Union (V0.9KG-2)

p. 2

TRANS JAIAgenda1. Policy and Objectives2. Aims3. Main Characteristics 4. Organization5. Development methodology6. Goal-based approach 7. Project Plan 8. The notion of project Streams 9. Contractual Methodology10. What it looks like11. Architecture 12. Products 13. Content14. Messaging, Protocols and Data-Interchange 15. Reconciliation16. Reconciliation Efficiency17. Lessons Learned18. Q & A

p. 3

TRANS JAI

Information Resources Manager of DG JLS MSc. in IT Systems and Telecommunication Networks Before he joined the EC, worked as IT systems and

networks consultant for the University of Athens

European Commission, Directorate General “Justice Libertéet Sécurité”

Speaker profile of Konstantinos BOVALIS

Company profile of Directorate General “Justice Liberte et Securite”

Introduction to our speaker #1

p. 4

TRANS JAIPolicy and Objective Regulation (EC) No 1049/2001 calls for improved access to legislative

procedures and for good administrative practices in order to facilitate access to documents. Information should be provided to the citizen on the progress and stage reached in the procedure for a legislative measure in all the institutions.

Following the addition of a comment in the budget calling for the creation of an inter-institutional server giving online access to documents related to the EU law-making process, Commissioner Vitorino, on 26 March 2003, accepted to launch a feasibility study and a pilot project applied to FSJ documents.

The objective of the “Transparency in the area of Freedom, Security and Justice” project (TRANS-JAI) is to increase transparency by means of a common interface aimed at facilitating the access to, and where appropriate the consultation of, documents related to the EU law-making process within the FSJ domain, that are held within the PUBLIC document systems of the:

Council; European Parliament; Commission and the OPOCE

The Policy

Objective

p. 5

TRANS JAIAims

To unify and reconcile documents stored on various systems, thus being an inter-institutional Portal covering the legislative processes in the FSJ area of both the 1st and the 3rd pillars.

Feed information back to any system (including the feeding ones) to improve the overall quality of the available information

For citizens (experts, students, press, etc.) who need to view legislative activities; all available interface languages

Provide a single access point (via a Web Interface) to public end-users

p. 6

TRANS JAIMain Characteristics (1/2) The “author” institutions decide what depth of information

to provide and are continually responsible for the content provided.

Information (metadata / attributes) provided automatically.

No duplication of source documents (referenced using embedded links in attributes).

For the Information Provider Systems, lightweight connections and flexibility using a standard exchange format.

Automatic updates and automatic reconciliation (… manual if needed).

Full multilingual search and retrieval using the Embedded EUROVOC thesaurus (http://europa.eu/eurovoc/ ), possibility of expansion with specific thesaurus.

Alerts, basket, profile personalization, etc.

p. 7

TRANS JAIMain Characteristics (2/2)

2. Reconcile

1. Collect 3. Publish 4. Display

CEU

CE

EP

OPOCE

Institutions TRANS-JAI Back-End TRANS-JAI Front-End

Administration Tools General Public site

IPS

p. 8

TRANS JAIOrganization

Inter-institutional Project Several Layers of Management

Project Owner: DG JLS Project Management: DG JLS/ Unit A5 (business needs) DG JLS / Unit A3 (IT

consulting) Information Providers: SG of the Commission, Council,

Parliament, and OPOCE Information Strategy: DG COMM System Hosting: DIGIT

High-level Steering Group is inter-institutional (all services and institutions)

Project Liaison Officers coordinate the work within the institutions and between services

p. 9

TRANS JAIDevelopment methodology

Interactive and on-going “user centred” design methodology which is similar to the Unified Process.

Confirmation of requirements during 9 workshops over 6 months with internal and external stakeholders

Prototypes Releases evaluated by both EXTERNAL persons (e.g. journalists, officials of BE Minister of Justice, students, etc) and INTERNAL persons inter-institutional users, stagiaires, legal librarians. TOT:> 100

Setting up project groups: Project Liaison Officers, Editorial, Taxonomy, Thesaurus & IT

p. 10

TRANS JAIGoal-based approach (1/2)

“Goals” are broken down into sub-goals

Each goal: Is assessed in term of being

achieved by specific “measurement criteria”

May be hindered by one or more problems, which can be resolved by new sub-goals

Is met by using a set of “recommended actions”

Goals are solved in a recursive way

A goal

A subgoal Another subgoal

Yet another subgoal

Goals defined prioritisation by using the MoSCoW methodology:

• M - MUST have this. • S - SHOULD have this if at all possible. • C - COULD have this if it does not affect anything else. • W - WON'T have this time but WOULDlike in the future.

p. 11

TRANS JAIGoal-based approach (2/3)

Typical Goal structure

Description & link to the parent goal(s)

Priority (following MoSCoW)

Causes and Potential Problems

Prerequisites

Recommended actions Activities Deliverables

p. 12

TRANS JAIGoal-based approach (3/3)G01 - TRANS-JAI provides up to date

transparent access to TRANS-JAI work and documents produced by the Institutions

G07 - Adaptation of content to user

profileG08 - Promotion

G02 - Popularity G03 - TransparencyG04 - Reconciliation G05 - Precocity

G06 - Usability G11 - Globally improve information quality of

other sites

G16 - Multilingualism

G10 - Access to TJAI documents

Information

G17 - Thematic browsing G09 - Powerful Search Facilities

G12 - Stable document references

G13 - Cover concerned

document types in each

Institution

G14 - Source information

systems provide info as fast as

possible

G15 - TRANS-JAI publishes information as fast as possible

p. 13

TRANS JAIProject Plan 10/2007: Cutover from current to Takeover contractor

3rd QTR 2008:

Good quality of metadata to permit satisfactory inter-institutional reconciliation

Begin Wide User Group evaluation (system open to national authorities, universities, expert groups, etc)

4th QTR 2009:

Satisfactory results of the Wider User Group/s evaluations, including multilingual retrieval;

Very good quality of metadata to permit satisfactory inter-institutional reconciliation

Green light to begin the preparations for the Public Opening

1st QTR 2010:

All appropriate resources, both technical and human, are in place and trained

23 EU Language system ready for the opening to the Public

What’s Next• Integration of other EU Institutions• Integration of Member States

legislation• Extension to Domains other than

FSJ

p. 14

TRANS JAI

The notion of “Project Streams”

Their aim is to facilitate multi-institutional project management

GROUP I: Stream 01 – Dynamic Contents Stream 02 – Messaging, Protocols and Data-Interchange Stream 03 – Reconciliation and Business Rules Stream 05 - Information DisplayGROUP II: Stream 04 – Fixed Content (incl. Themes, GPU words, …) Stream 06 – FSJ Multifunctional Thesaurus and FSJ TaxonomyGROUP III: Stream 07 – Search and Retrieval…GROUP V: Stream 08 – Hosting at Commission’s Data Centre

p. 15

TRANS JAI

Contractual Methodology

Contracts are made using the Quoted Times and Means method:

A bundle of work is initially assessed (in terms of man-days) and work is then executed by the means of smaller “quotes” (paid based on the tasks completed within them)

1 Specific Contract = 1 Phase

STREAM1

STREAM2

STREAMx

PHASE2PHASE1 PHASEx

1 Quote = 1 WP (can run in parallel)

WP1

WP2

WPx

p. 16

TRANS JAI

What it looks like (1/4)

How it looks lik

e

p. 17

TRANS JAI

How it looks lik

e


p. 18

TRANS JAI


How it looks lik

e

p. 19

TRANS JAI

AttributesFile


p. 20

TRANS JAIIntroduction to our speaker #2

Enterprise Content Management consultant Information Architect

Getronics Belgium

Speaker profile of Denis DJEMBI

Company profile of GETRONICS BELGIUM

p. 21

TRANS JAIArchitecture (1/2)cd Accepted scenario for LGL

Scenario 3

In ternetIntranet / Extranet

:Index Serv er

:Documentum 5.3

:End user (general public)

:End user (administrator)

«web client»:Administrator

«web client»:General Public

«web application»:General Public

Application Serv er

«search engine»:Verity K2

«data repository»Dynamic Contents

«search engine»:Index Serv er

Scenario 3


:Index Serv er

:Documentum 5.3






Application Serv er




Scenario 3


:Index Serv er

:Documentum 5.3






Application Serv er




Scenario 3


:Index Serv er

:Documentum 5.3






Application Serv er




indexing search

dynamiccontentsre trieval

Full featured searchcapabilit ies

Write access touser pre ferencesAdminister dynam ic

contents (read / write)

Standard Searchcapabil it ies

Publ ish dynam ic contents

p. 22

TRANS JAIArchitecture (2/2)IPS system TRANS-JAI system

Back-End subsystem Front-End subsystem

Documentum Core Serv ices

+ Administrator+ Documentum Administrator (DA)+ T RANS-JAI Administrator

Verity K2 Search Engine Serv icesRSS Aggregator Serv ices

Reconciliation Dev elopped AddOn Serv ices

General Public Application Serv ices

General Public userDynamic Contents Files

+ RSS Files+ XML Files

IPS system

Public Document Files

+ Document Files

push meta-data

retrieve file

«http»

Full Text indexation(retrieve file)

«http»

hyperlinkreference

checkhyperl ink

«http»

generates

retrieve files

«http»

use

search forinformation

«http»

p. 23

TRANS JAIProducts

«dedicated resource»A. TRANS-JAI Serv er

+ Documentum 5.3 standard components+ TRANS-JAI specifc components

«shared resource»C. Verity K2 Serv er

+ K2 Broker+ K2 Collection+ K2 Dashboard+ K2 Master+ K2 Report+ K2 Server

«shared resource»D. WebLogic Server

+ Applicative Web Server (Intranet)+ Applicative Web Server (Publ ic)+ DCTM WCM SCS Target

«shared resource»B. Oracle Serv er

+ Administrator Assistant+ Database Administrator Assistant+ DCTM Content server instance+ DCTM WCM instance

Documentum 5.3 standard components

+ DCTM Administrator+ DCTM Appl ication Builder+ DCTM Business Process Manager+ DCTM Content Server+ DCTM Content Server File Repository+ DCTM Index Server+ DCTM WCM File repository+ DCTM WCM SCS Source+ DCTM WCM WebPublisher+ DCTM WDK+ DCTM Webtop

TRANS-JAI specifc components

+ Client - Administrator+ Client - General Public+ Data - FSJ Global Thesaurus+ Data - FSJ XML Message Samples+ Service - BIF Generator+ Service - FSJ application

p. 24

TRANS JAIContent

Procedure co-decision consultation cooperation procedures

FSJ Dossier: all the events related to a particular legislative process and their corresponding documents

Institutional Dossier

Event: step in the process of a well-defined procedure

Document: An electronic entity that has attributes and (may or may not have) content (.pdf, .doc, .xls, etc)

p. 25

TRANS JAI

Messaging, Protocols and Data-Interchange

The TRANS-JAI XML message format for Dynamic Contents

The EU Institution’s RSS 2.0 feed.

RSS is an XML-based vocabulary that specifies a means of describing news or other Web content that is available for "feeding" (distribution or syndication) from an online publisher to Web users.

A Web site that wants to "publish" some of its content creates a description of the content and specifically where the content is on its site in the form of an RSS document.

A user with an RSS aggregator or browser can read periodically provided distributions.

News is only one form of content that can be distributed with an RSS feed. Other possibilities include discussion forum excerpts, software announcements, and any form of content retrievable with a URL.

p. 26

TRANS JAIReconciliation

The TRANS-JAI business process starts when a dossier, a document or a procedure is provided to TRANS-JAI by one recognized institution in form of a set of attributes with, when appropriate, a link to the document.

It ends when the dossier, document or procedure information is accessible from the General Public User interface.

Reconciliation objectives

To know if: all legislative documents related to a given procedure have been linked to the relevant procedure or dossier

p. 27

TRANS JAIReconciliation Efficiency (1/5)

Reconciliation process

IPS provides information (metadata) about documents, dossiers and procedures.

Based on specific metadata, initiating documents are detected and automatically associated with their related items in a TRANS-JAI dossier (e.g. document reference and version, related documents reference, inter-institutional procedure reference, internal dossier reference).

p. 28

TRANS JAIReconciliation Efficiency (2/5)

p. 29

TRANS JAI

Evaluation of Reconciliation – Objectives

Assess the efficiency of the TRANS-JAI system when

Automatically detecting the documents initiating a legislative process.

Automatically associating the dynamic data relating to a legislative process (documents, dossiers and procedures information) with its initiating document.

Reconciliation Efficiency (3/5)

p. 30

TRANS JAI

Evaluation of Reconciliation - MethodFor each type of test:1. Define a reference data set (expected results)

Identify the potential initiating documents and, for a selected set of initiating documents, identify the related items (documents, dossiers and procedures).

2. Execute the testCompare expected results specified by the Reference data set with the dynamic content stored in the TRANS-JAI repository.

3. Analyse and reportProduce report and calculate indicators measuring the information retrieval efficiency (Recall, Precision and F-measure).


p. 31

TRANS JAI

Evaluation of Reconciliation - Method Both mathematic and qualitative analysis

Mathematic indicators: Recall = the ratio of the number of relevant

records retrieved to the total number of relevant records in the database. It is expressed as a percentage.

Precision = the ratio of the number of relevant records retrieved to the total number of irrelevant and relevant records retrieved. It is expressed as a percentage

F-measure = the weighted harmonic mean of precision and recall (method used to calculate an average)

Qualitative analysis: Try to understand why the evaluation results are

not satisfactory and specify how to improve them (e.g. review the business rules, analyze the notification provided by the IPS…).


p. 32

TRANS JAI

Define with the stakeholders over several iterations the “vision”and the goals to be achieved.

Establish a well defined project organization and get the necessary commitments from the Management.

Using Project Liaison Officers, permit the other organisations to define their own internal project structure.

Establish the formal involvement of the different parties with exchange of letters and later put in place SLAs.

Project management is a heavy activity when it comes to an inter-institutional project; reserve the necessary resources.

Essential to have users in the centre of the testing process in an iterative way to obtain and validate requirements.

Lessons Learned (1/2)

p. 33

TRANS JAI

To find the solution to the problem needing to be solved within the project, may need to use very new software not yet in the organisations standard product list.

The use of commercial off-the-shelf solutions is a wise choice; it gives stability and reduces the development effort; however be prepared to find incompatibilities between the development and the production environment (different technological platforms, different rules for running the operational activities).

Lessons Learned (2/2)

p. 34

TRANS JAI

Q & A

Documents

TRANS-JAI€¦ · TRANS JAI Messaging, Protocols and Data-Interchange The TRANS-JAI XML message format for Dynamic Contents The EU Institution’s RSS 2.0 feed. RSS is an XML-based