Upload
others
View
7
Download
0
Embed Size (px)
Citation preview
The Programme “Online Audiovisual Archive of Research in Social Sciences
and Humanities” (AAR)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
PETER STOCKINGER
Equipe Sémiotique Cognitive et Nouveaux Médias (ESCoM)Fondation Maison des Sciences de l’Homme (FMSH)
Institut National des Langues et Civilisations Orientales (INALCO)
Lingnan University – Hong Kong
10th of April 2007
Design graphique et multimédia : Elisabeth de PABLO, MSH
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The main topics of this lecture are the following three ones:
1. Short presentation of the French programme « AudiovisualArchives of Research » (Archives audiovisuelles de la Recherche; AAR).
2. Presentation and discussion of the publishing of digital audiovisual and multimedia resources dedicated to thepreservation, valorisation and exploitation of scientific andcultural heritage.
3. The principal challenges for digital multimedia librairies (in a European perspective).
Lecture
Topics
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
1st topic
- A short presentation of the AAR programme and itsaudiovisual and multimedia web portal -
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
1st topic
Text, information and culture
AAR is an important production, R&D and publishing programme launched by Prof. Peter Stockinger ESCoM in his R&D lab during 2002 in Paris and aiming at :
the constitution of an audiovisual, multimedia portal of scientific heritage in social and human sciences;
the exploitation of the audiovisual content in research (scientific communication), education (pedagogical communication), science popularisation (popularisation), …
Concretely speaking:
actually more than 3400 hours of videos and other digital resources
composed of interviews, research seminars, reportages, documentaries, …) in almost all domains of social and human sciences.
Online exploration of the AAR: http://semioweb.msh-paris.fr/AAR
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 1 shows the home page of the web site hosting the AAR audiovisual and multimedia resources.
(figure 1)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 2 shows one possible access to the online audiovisual and multimedia resources of AAR – the collections or series composing the archives. In our concrete case: the series of more than 260 interviews (with scholars, researchers, artists, …).
(figure 2)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 3 shows a selection of video resources belonging to the series of more than 50 reportages and documentaries.
(figure 3)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 4 shows the access to the audiovisual and multimedia resources via a thematic catalogue. The chosen example: “World Languages and Literatures” composed of more than 30 entries.
(figure 4)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 5 shows the access to the audiovisual resources of the AAR with the help of a search engine and by means of key words. Concrete example: “Chinese literature” composed of about 17 entries.
(figure 5)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 6 shows the home page of one of the thematic knowledge spacesof the AAR programme dedicated to the cultural heritage of minorities and social groups (“PCI”) composed of about 380 hours of video material.
(figure 6)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 7 shows another thematic knowledge space of the AAR Programme dedicated to the linguistic and cultural diversity of mankind (“DLC”) composed of about 400 hours of video material.
(figure 7)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 8 shows the access to the whole collection of audiovisual resources documenting the activities of ALBI (Annie Curien, CNRS/FMSH) representing more than 90 hours of video material.
(figure 8)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 9 shows the home page of one specific ALIBI workshop hold in Shanghai.
(figure 9)
1st topic
The AAR Programme
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
2nd topic
- The « interactive hypermedia book » (IHB) -
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The interactive hypermedia book (abbreviated: IHB) is a specific publishing genre of a given (closed or open) source corpus composed either exclusively by audiovisual sources or by different media sources.
It is – historically speaking – the principal publishing genre of the audiovisual and multimedia resources belonging to the AAR.
As its name already suggests, it is built in analogy to the “written book organised in chapters” which is a traditional publishing genre with some very well known general stereotypic characteristics such as:
the presence of a cover with recurrent (paratextual) information (title, author, publisher, ...);
the overall organisation in chapters, sections, etc.;
the presence of notes, an index, bibliographical information;
a textually linear ordering of sections, chapters, … but which hasn’t to be followed necessarily by the reader.
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hongkong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The actually online interactive hypermedia book is in French with the title “L’univers des indiens huarpe de Guanachache” (English : “The –natural and cultural – world of the huarpe indios living in the Guanacacheregion”).
(figure 10)
The figure 9 above shows the “cover page” of the interactive book as well as the contents of it (cf. region within the red circle).
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The figure 11 below show the pop up window containing the videosection of the interactive book which are, in this case, very simple:
they are ordered following the temporal progress of the series of interviews;
each of them contains the “video text” in three formats as well as (virtually) other information resources completing the video text
(figure 11)
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Example : a series of interviews with Gregorio Manzur dedicated to the life world and culture of the huarpe croppers),
Source corpus:
mainly the video files documenting the series of interviews with the Argentinean writer,
some simple textual information composing the bibliography and biography of Gregorio Manzur,
as well as some static visual resources (i.e. images),
unpublished documents and writings of G. Manzur,
web sites documenting the world and life of the huarpe croppers.
The source corpus is an open one (it can be enriched by new video files or by other multimedia resources) .
The actually online available interactive hypermedia book may dynamically change – the interactive hypermedia book doesn’t possess a fixed, determined form (new headings may be added, new “video chapters”may be added, …)
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
From the point of view of the overall objectives that a hypermedia book is presumably able to fulfil:
The huarpe hypermedia book in its actual version :
tends to be above all a faithful report of what Gregorio Manzur has related about the huarpe civilisation:
it hasn’t any other specific objective than the trustful reporting of Mannzur’s discourse.
But other versions of this IHB:
may have other objectives: overtly pedagogical ones, political ones, moralizing ones, etc.
may be elaborated especially with respect to specific user groups, etc.
and will require, for this:
specific contents and specific comments and enrichments of selected video contents;
specific functional parts and specific fitting (organisation) of functional parts
specific interfaces .
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
In order to be able to produce such “other” versions of the actual version of the huarpe hypermedia book, we :
have to understand more explicitly the organisation, the structure of an IHB, i.e. its “grammar” as a genre or publishing genre;
have to understand the typical activities of “versioning”, of the rewriting of given source corpuses or again given, existing versions belonging to a specific genre, a specific publishing genre (viz., in our case, the IHB).
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Discussion : The overall formal structure of THIS version of aninteractive hypermedia book is simple. It is represented by figure 12 below
(figure 12)
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Discussion : The basic architecture for ALL video-book like realisations are shown in the diagram above (figure 13)
(figure 13)
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Explanations
Parts: the elements that compose an interactive hypermedia book
Functional parts are, for example, the different “chapters”, especially the video chapters (composing one or more “headings”), the “cover page” (“home page”), an introduction, etc.
Physical parts are mainly the “page” itself and the different regions or zones that compose its interface (menu, text zone, image zone, …)
Fitting of parts means the ordering:
between the different chapters (and sub-chapters, …);
among the different regions and zones organising a physical page.
Graphical interface :
recovers all (figurative – eidetic -, topographical, chromatic, textual, …) elements
that compose the zones and regions of a page and that is mainlyresponsible of what is called the “visual chart” or identity of an IHB
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
“Source corpus” recovers all content data that are used for the authoring of an IHB:
“brute” video files (in our case, dominant), image files, sound files, textual files
“structured information”
and also already authored but reusable products (already existing, IHB, video-lexica, hypermedia encyclopaedias, multilingual versions, etc.); etc.
“Format” means that an IHB is a publishing type or genre
that can be “materialised”, physically transported and “consumed”for instance as a web site, a cderom, an ipod service, a psp service, a service for mobile phones or again a service of i-TV, etc.
Notice: the materialisation, transportation and consumption of an IHB and of any other type or genre of information or knowledge product
is determined by the specific technological, economical, social and also cultural constraints that characterise the use of the listed communication devices.
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
In any case, the “authoring” of IHB can be technically represented as a set of activities that apply to the above quoted elements in order to produce a concrete IHB.
The whole authoring process of a hypermedia book can be decomposed in routine steps and tasks which are:
1. Synopsis writing.
2. Source corpus collection and constitution.
3. Critical working through the source corpus and scenario designof the hypermedia book.
4. Processing (working on) the video content (for the “video heading”) as well as on other content for previously in the scenario identified headings.
5. Editing of the processed (video and other content) via publishing templates or models.
6. Publishing of the hypermedia book as a web site, a cdrom, a product for mobile devices, etc.
2nd topic
The« interactive »hypermediabook (IHB)
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
3rd topic
- The AAR audiovisual and multimedia resources: challenges and actually ongoing activities -
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
List of principal challenges that the audiovisual and multimedia resources of the AAR are facing:
transform this material in a useful tool for formal (secondary, higher) education
transform this material in a useful tool for informal learning (life long learning, u-learning, …)
open this material to a multilingual and multicultural knowledge market
use this material for other objective bounded purposes: political communication, social communication, …
re-use this material in order to contribute to the dialogue “culture, science and citizen”
prepare this material as a knowledge heritage of the actual generation left for future generations
prepare this material for its critical use in the construction of new knowledge.
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
This means especially :
the re-authoring or again the repurposing of a given source corpus
with respect to given communication objectives, user groups and exploitation contexts
as well as with respect to chosen genres, publishing genres that are more or less well attuned to the just quoted constraints.
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Actually ongoing R&D as well as teaching and learning activities for handling these challenges:
several French and European R&D projects (SAPHIR, LOGOS, DIVAS) dealing with the elaboration and implementation of methodologies and tools for re-authoring audiovisual corpuses as well as for annotating them for different destines or publics;
work with students on specific audiovisual corpuses in order to republish them as bilingual montages; hyper-documentations, thematic folders, video-lexica, etc.
Methodology: semiotic of digital audiovisual document
Tool: Interview – the semiotic workshop for re-authoring or repurposing multimedia source corpuses
First results:
Bilingual versions of audiovisual resources belonging to the AAR;
Multimedia online documentation dedicated to a specific problem, question, theme, etc.
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The Interview tool interface – the segmentation of video corpuses (figure 14).
(figure 14)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
Figure 17 show the 7 principal steps that have to be passed through in order to produce re-authored versions of a source corpus (figure 15).
(figure 15)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The 7 principal steps are:
1/ Textual description (Step 1):
each segment will receive a title and a very short summary in the target language
2/ Translation &Versioning (Step 2):
each segment has to be “translated” in the target language –translation can take the form of sub-titles, key word translation (“telegraphic style”), a word-to-word translation, a free version, etc.
3/ Thematic description (Step 3):
a segment can be described, in the target language, with respect to the principal topics developed in it
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The 7 principal steps are:
4/ Keyword description (Step 4):
keywords referring to people, places, times, monuments, naturalenvironment, symbolic environment, etc. can be provided for eachsegment in the target language
5/ Peritextual description (Step 5):
each segment can be enriched, enhanced for people composing the target culture by means of links to other online resources or useful comments
6/ Paratextual description (Step 6):
the whole description has to be presented as an MMS realisation in a chosen target language and for a chosen target user (general title of the realisation, authors, …).
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
First results – bilingual versions of monolingual videos. Example: translation and adaptation for a Russian community of a conference given in English by Faleh Jabar (Iraq) on the Salafi suicide bombers in Iraq.
(figure 16)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The homepage of the bilingual English/Russian version produced by Olga Anissimova from the Tartu University in Estonia (figure 17).
(figure 17)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The list of newly identified and processed segments for the Russian public (figure 18).
(figure 18)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The interface for reading and appropriating the content of a chosen segment in Russian and for Russian people (figure 19)
(figure 19)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)
© Equipe Sémiotique Cognitive et Nouveaux Médias(Escom) – Paris
The actually available – and yet very small – list of bilingual versions on the AAR web portal (figure 20).
(figure 20)
3rd topic
Challenges and ongoingactivities
Peter Stockinger: The AAR (Hong Kong, 2007)