|
|
Catherine PelachaudDipartimento di
Informatica e Sistemistica |
· Vitae
· Project
· Research
Vitae
I received my PhD in Computer Graphics at the University of Pennsylvania , Philadelphia, USA 1991, under the supervision of Norman Badler, and Mark Steedman . In 1993-1994 I was involved in a project funded by a National Science Foundation grant that produced a system which automatically generates and animates conversations between multiple human-like agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures with Norman Badler , Justine Cassell, Scott Prevost , and Mark Steedman . In 1993 I was part of the organisation of a workshop, sponsored by NSF, on standards for facial animation hold at the University of Pennsylvania. In 1993-1996 I was a post-doctorate at the University of Rome at the computer science department with a Human Capital and Mobility grant.
Project
In 1998 I worked in the Spoken Language Working Group part of the EAGLES (Expert Advisory Group on Language Engineering Standards) project funded by the European community to promote standards and distribution of resources in the spoken language field. I am currently working in the Natural Interaction and MultiModality group which is part of the European project ISLE. ISLE is a project on International Standards for Language Engineering whose aim is to develop and promote Human Language Technologies standards and guideline for language resources, tools and products. I am also part of a 3-years European project MagiCster whose final goal is to realize a new type of human-computer interface: the conversational character. In particular I am interested in the believability aspect of the agent, looking at how the agent should combine verbal and non-verbal behavior in an appropriate and tightly synchronized way.
Research
- I am collaborating with Isabella Poggi, Fiorella de Rosis, Nadja De Carolis on the creation of Contextually Believable Embodied Agent that is an agent capable of planning what to communicate as well as deciding with which verbal and nonverbal signals to output considering contextual information. While planning what to say the agent has to consider what to communicate nonverbally (through gaze, facial expression, head movement). The choice of the communicative act to perform is based on whom we are taking to, what is our relation with our interlocutor, and in which context the conversation takes place.
· In collaboration with Emanuella Magno-Caldognetto, Piero Cosi and Claudio Zmarich from the Istituto di Fonetica e Dialettolodia del CNR of Padova, I am working on a computational model of lip movements. Our goal is to create a natural Italian talking face with, in particular, lip-readable movements. Based on real data extracted from an Italian speaker with the ELITE system, we have approximated the data using radial basis functions. Our experiment is based on some phonetic-phonological considerations on the parameters defining labial orifice, and on identification tests of visual articulatory movements.
·
With Stefano Pasquariello, we have developed a 3D
facial model based on MPEG-4 standard.
Selected publications
2003
· C.
Pelachaud, M. Bilvi, Computational Model of Believable Conversational Agents, in Communication in MAS: background,
current trends and futur, Marc-Philippe Huget (Ed), Springer-Verlag, to
appear, 2003. PDF
2002
· C.
Pelachaud, Visual
Text-to-Speech, in MPEG4 Facial Animation - The standard, implementations
and applications, Igor S. Pandzic, Robert Forchheimer (eds.), John Wiley &
Sons, 2002. ZIP
- C. Pelachaud, I. Poggi, Subtleties of Facial Expressions in
Embodied Agents, Journal of Visualization and Computer Animation, to
appear, 2002. PDF
- Z. Ruttkay, C. Pelachaud, Exercises of style for virtual humans,
Animating Expressive Characters for Social Interactions, Symposium of the
AISB'02 Convention, London, April 2002. PDF
- C. Pelachaud, V. Carofiglio, B. De Carolis, F. de Rosis, I. Poggi,
Embodied Contextual Agent in Information Delivering Application,
First International Joint Conference
on Autonomous Agents & Multi-Agent Systems, Bologna, July 2002.
PDF
- B. Hartmann, M. Mancini,
C. Pelachaud, Formational parameters and adaptive prototype
instantiation for MPEG-4 compliant gesture synthesis,Computer
Animation, Geneva, june 2002. PDF
2001
· S. Pasquariello, C. Pelachaud, Greta: A Simple Facial Animation Engine, 6th Online World Conference on Soft Computing in Industrial Appications, Session on Soft Computing for Intelligent 3D Agents, Septembre 2001. PDF
· C. Pelachaud, E. Magno-Caldognetto, C. Zmarich, P. Cosi, An Approach to an Italian Head, Eurospeech'01, Aalborg, Danemark, 3-7 septembre 2001.
· C. Pelachaud, E. Magno-Caldognetto, C. Zmarich, P. Cosi, Modelling an Italian Talking Head, Audio-Visual Speech Processing, Scheelsminde, Danemark, 7-9 septembre 2001. PDF
· B. De Carolis, C. Pelachaud, I. Poggi, F. de Rosis, Behavior Planning for a Reflexive Agent, IJCAI - 2001, Seattle, September 2001. zipped Postscript or PDF
· J.N. Cappella, C. Pelachaud, Rules for Responsive Robots: Using Human Interactions to Build Virtual Interactions, In A.L. Vangelisti, H. T. Reis, and M. A. Fitzpatric (Eds.), Stability and Change in Relationships, New York: Cambridge University Press, 2001. PDF
· C. Pelachaud, Contextually Embodied Agents, in N. Magnenat-Thalmann and D. Thalmann, editors, Deformable Avatars, Kluwer Academic Publishers, 2001. PDF
· C. Pelachaud, I. Poggi, B. De Carolis, A reflexive, not impulsive Agent, poster at The Fifth International Conference on Autonomous Agents Montreal, May 2001. PDF
· C. Pelachaud, I. Poggi, Towards Believable Interactive Embodied Agents, workshop Multimodal Communication and Context in Embodied Agents , Montreal, in conjunction with The Fifth International Conference on Autonomous Agents, May 29, 2001. zipped Postscript or PDF
2000
· I. Poggi, C. Pelachaud, Emotional Meaning and Expression in Performative Faces, In A.Paiva (Ed.), Affective Interactions: Towards a New Generation of Computer Interfaces, Berlin, Heidelberg, New York: Lecture Notes in Computer Science n. 1814, Springer-Verlag, 2000. zipped Postscript or PDF
· C. Pelachaud, Generation of facial communicative functions in face-to-face conversation, Invited lecture, The fourth Swedish symposium on Multimodal Communication (SSoMC), Kista, October 26-27, 2000.
· I. Poggi, C. Pelachaud, Gaze and its meaning in animated faces, In P. McKevitt (Ed.) Language, vision and music. Amsterdam: John Benjamins, 2000. zipped Postscript or PDF
· I. Poggi, C. Pelachaud, Performative facial Expressions in Animated Faces, In J. Cassell, J. Sullivan, S. Prevost, E. Churchill (Eds.), Embodied Conversational Agents, Cambridge (Mass.): MIT Press, 2000, pp.155-188. PDF
· B. Benoît, J.-C. Martin, C. Pelachaud, L. Schomaker, B. Suhm, Audio-Visual and Multimodal Speech-based Systems, In D. Gibbon, I. Mertins, R.K. Moore (Eds.), Handbook of Standards and Resources for Spoken Language Systems, Kluwer, 2000.
· I. Poggi, C. Pelachaud, F. de Rosis, Eye Communication in a Conversational 3D Synthetic Agent, In E. Andrè, (Ed.), Special Issue of Artificial Intelligence Communications, The European Journal on Artificial Intelligence, IOS Press, vol 13 (3): 169-181, 2000. zipped Postscript or PDF
· B. De Carolis, C. Pelachaud, I. Poggi, Verbal and nonverbal discourse planning, Proc. of the Workshop on “Achieving Human-Like Behavior in Interactive Animated Agents”, in conjunction with The Fourth International Conference on Autonomous Agents, Barcelone, Spain. 3 june, 2000. zipped Postscript or PDF
· C. Pelachaud, Some considerations about embodied agents, Proc. Of the Workshop on “Achieving Human-Like Behavior in Interactive Animated Agents”, in conjunction with The Fourth International Conference on Autonomous Agents, Barcelone, Spain. 3 June, 2000. zipped Postscript or PDF
· C. Pelachaud, S. Pasquariello, GRETA, una faccia parlante, XI Giornate di Studio del Gruppo di Fonetica Sperimentale, Multimodalità e Multimedialità nella Comunicazione, Padova, Italy, November 2000.
· Poggi, C. Pelachaud, N.De Carolis, F. de Rosis, Facce parlanti ed espressive per agenti impulsivi o riflessivi, XI Giornate di Studio del Gruppo di Fonetica Sperimentale, Multimodalità e Multimedialità nella Comunicazione, Padova, Italy, November 2000.
1999
· I. Poggi, C. Pelachaud, Emotional Meaning and Expression in Performative Faces, In A.Paiva & C.Martinho (Eds.) Affect in Interactions. Proc. of the Workshop of the 3rd i3 annual Conference, Siena, Italy, 21-22 October 1999, pp.122-126.
· C. Pelachaud, I. Poggi, F. de Rosis, Study and Generation of Coordinated Linguistic and Gaze Communicative Acts, In E. Lamma e P. Mello (Eds.) AI*IA '99. Atti del VI Congresso dell'Associazione Italiana per l'Intelligenza Artificiale. Bologna, Italy: Pitagora Ed., 1999, pp.248-257.
· I. Poggi, N. Pezzato, C. Pelachaud, Gaze and its meaning in animated faces, In P. McKevitt (Ed.) CSNLP-8 (Cognitive Science and Natural Language Processing), Proc. of the Workshop on “Language, vision and music", Galway (Ireland), 9-11 August 1999, pp.33-40.
· I. Poggi, C. Pelachaud, Le facce parlanti e l'espressione facciale del performativo, 6 Convegno Nazionale “Informatica, Didattica e Disabilità”, Andria, 4-6 November 1999.
· I. Poggi, C. Pelachaud, F. de Rosis, Eye Communication in a Conversational 3D synthetic Agent, i3 Spring Days Workshop on “Behavior Planning for Life-Like Characters and Avatars”, Sitges, Spain, 9-10 March 1999.
1998
· I. Poggi, C. Pelachaud, Performative faces, Speech Communication, vol 26: 5-21, 1998. PDF , figures
· C. Pelachaud, J. Cassell, N. Badler, M. Steedman, S. Prevost, M. Stone, Synthesizing Cooperative Conversation, in H. Bunt and R.-J. Beun (Eds.), Multimodal Human-Computer Communication - Systems, Techniques and Experiments, Springer Lecture Notes in Artificial Intelligence 1374, 1998.
· I. Poggi, C. Pelachaud, Talking faces that communicate by eyes, In S. Santi, B. Guaitella, C. Cavé and G. Konopczynski (Eds.) "Orage'98. Oralité et gestualité, communication multimodale, interaction", Paris: L'Harmattan, 1998, pp.211-216. PDF
· C. Pelachaud, I. Poggi, Facial Performative in a Conversational System, Workshop on Embodied Conversational Characters, WECC'98, Lake Tahoe, USA, October 1998. zipped Postscript or PDF
· C. Pelachaud, I. Poggi, Multimodal Communication between Synthetic Agents, In T. Catarci, M.F. Costabile, G. Santucci and L. Tarantino (Eds.), Proc. of the Working Conference on Advanced Visual Interfaces. L'Aquila, Italy, 26-27 May, 1998, pp.156-163. zipped Postscript or PDF
1997
· I. Poggi, C. Pelachaud, Context sensitive faces, In R.Campbell and C.Benoît (Eds.), Proceedings of the ESCA Workshop on Audio-Visual Speech Processing, Rhodes, Greece, 24-27 September 1997, pp. 17-20. zipped Postscript or PDF
1996
· N.I. Badler, B.L. Webber, W. Becket, C. Geib, M. Moore, C. Pelachaud, B. Reich, M. Stone, Planning for Animation, in N. Magnenat-Thalmann and D. Thalmann (Eds.), Interactive Computer Animation, Prentence Hill, 1996.
· C. Pelachaud, N.I. Badler, M. Steedman, Generating Facial Expressions for Speech, Cognitive Science, vol 20(1):1-46, January 1996. zipped Postscript or PDF
· C. Pelachaud, S. Prevost, Monologues of Talking Heads, Eurographics, Poitier, France, August 1996. zipped Postscript or PDF
· C. Pelachaud, Simulation of Face-to-Face Interaction, Advanced Visual Interfaces, Gubbio, Italy, May 1996.
1995
· C. Pelachaud, S. Prevost, Coordinating Vocal and Visual Parameters for 3D Virtual Agents, In M. Göbel (Ed.), Virtual Environments'95, Springer-Verlag, Computer Science Series, 1995, pp. 99-106. zipped Postscript or PDF
· N.I. Badler, C. Pelachaud, A workshop on standards for facial animation, ACM SIGGRAPH Computer Graphics, vol 29(2):66-67, May 1995.
· C. Pelachaud, S. Prevost, Talking Heads, one-day course Computer Graphics International, Leeds, England, June 1995. zipped Postscript or PDF
· N.I. Badler, B.L. Webber, W. Becket, C. Geib, M. Moore, C. Pelachaud, B. Reich, M. Stone, Planning and Parallel Transition Networks: Animation's New Frontier, Proc. Of Pacific Graphics '95, Seoul, Korea. World Scientific, 1995.
· C. Pelachaud, J. Cassell, N. Badler, M. Steedman, S. Prevost, M. Stone, Synthesizing Cooperative Conversation, International Conference on Cooperative Multimodal Communication, Theory and Applications, vol. 2, Eindhoven, The Netherland, May 1995, pp. 237-256.
1994
· C. Pelachaud, N.I. Badler, M.L. Viaud, Standards for Facial Models, workshop report "Standards for Facial Models", National Science Foundation, 1994. zipped Postscript or PDF
· C. Pelachaud, S. Prevost, Sight and Sound: Generating Facial Expressions and Spoken Intonation from Context, Proc. of the second ESCA/AAAI/IEEE Workshop on Speech Synthesis, New Paltz, NY, USA, September 1994, pp. 216-219. zipped Postscript or PDF
· J. Cassell, M. Steedman, N.I. Badler, C. Pelachaud, M. Stone, B. Douville, S. Prevost, B. Achorn, Modeling the Interaction between Speech and Gesture, Proc. of the 16th Annual Conference of the Cognitive Science Society, Georgia Institute of Technology, Atlanta, USA, August 1994. zipped Postscript or PDF
· J. Cassell, C. Pelachaud, N.I. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost, M. Stone, ANIMATED CONVERSATION: Rule-based Generation of Facial Expression, Gesture and Spoken Intonation for Multiple Conversational Agents, Computer Graphics Annual Conference Series (SIGGRAPH'94), Orlando, USA, July 1994, pp. 413-420. zipped Postscript or PDF
· C. Pelachaud, C.W.A.M van Overveld, C. Seah, Modeling and Animating the Human Tongue during Speech Production, Computer Animation '94, Geneva, Swisszerland, May 1994, pp. 40-49. zipped Postscript or PDF
· J. Cassell, C. Pelachaud, N.I. Badler, M. Steedman, Automatically Generating Conversational Behaviors in Animated Agents, Lifelike Computer Characters, Snowbird, UT, USA, October, 1994, pp. 20-21.
1993
· C. Pelachaud, Consideration of Facial and Audio Channels for a Facial Animation System, SCAN'93, Philadelphia, USA, November 1993.
· C. Pelachaud, M.L. Viaud, H. Yahia, Rule-Structured Facial Animation System, IJCAI, vol.2: 1610-1615, Chambery, France, August 1993. zipped Postscript or PDF
· C. Pelachaud, Etudes sur la Correspondance des Signes Faciaux et Vocaux pour l'Animation Faciale, Actes Société de Bibliologie et de schématisation, 1993.
1992
· C. Pelachaud, Functional Decomposition of Facial Expressions for an Animation System, Advanced Visual Interfaces, Rome, Italy, May 1992.
· C. Pelachaud, N.I. Badler, M. Steedman, Correlation of Facial and Vocal Expressions for Facial Animation, Interface to Real and Virtual Worlds, Montpellier, France, March, 1992.
1991
· C. Pelachaud, N. Badler, M. Steedman, Linguistic Issues in Facial Animation, in N. Magnenat-Thalmann and D. Thalmann, (Eds), Computer Animation '91, pp. 15-30, Springer-Verlag, 1991. zipped Postscript or PDF
· C. Pelachaud, Communication and Coarticulation in Facial Animation, Ph.D. thesis, nº MS-CIS-91-77, University of Pennsylvania, 1991. zipped Postscript or PDF
· S. Platt, A.T. Smith, F. Azuola, N.I. Badler, C. Pelachaud, Structure-Based Animation of the Human Face, nº MS-CIS-91-15, University of Pennsylvania, 1991.
1990
· C. Pelachaud, N. Badler, M. Steedman, Issues in Facial Animation, nº MS-CIS-90-88, University of Pennsylvania, 1990.