since Dec. 1998

Multimodal Presentation Markup Language: MPML

MPML (Multimodal Presenation Markup Language) is an XML-based language developed to enable the description of multimodal presentation using charactor agents in easier way.

This page offers documents related to MPML as well as sources and tools.
Comments and ideas are very welcome.

WHAT'S NEW

Jan/1999: MPML Ver. 1.0 officially released.
Feb/1999: MPML Ver. 1.03 upgraded version released.
Feb/1999: MPML Converter "MPML2MSAScript" released
Feb/2000: MPML Ver. 2.0e officially released
Feb/2000: MPML Player "ViewMpml" released
Jul/2001: MPML Ver 2.0a (implementing XSL) officially released
Jan/2002: MPML Ver. 2.2a (capable of working with Flas movie) officially released.
March/2002: MPML-VR (MPML-Virtual Reality) released.
June/2002: DWML (Dynamic Web Markup Language, a derivative of MPML) added to this page.
Dec/2002: MPML Ver. 3.0 released.

1. T. Tsutsui, S. Saeyor and M. Ishizuka:
   MPML: A Multimodal Presentation Markup Language with Character Agent Control Functions,
   Proc.(CD-ROM) WebNet 2000 World Conf. on the WWW and Internet, San Antonio, Texas, USA, (2000.10.30-2000.11.4) [PDF file(105KB)]

2. Yuan Zong, H. Dohi, H. Prendinger and M. Ishizuka:
   Emotion Expression Function in Multimodal Presentation,
   Advances in Multimodal Interfaces--ICMI2000 (Proc. 3rd Int'l Conf. on Multimodal Interfaces, Beijing, China) (T. Tan, Y Shi and W. Gao (Eds.)), Lecture Notes in Computer Science 1948, pp.57--64, Springer (2000.10) [PDF file(110KB)]

3. Yuan Zong, H. Dohi and M. Ishizuka:
   Multimodal Presentation Markup Language MPML with Emotion Expression Functions Attached,
   Proc. 2000 Int'l Symp. on Multimedia Software Engineering (IEEE Computer Soc.), pp.359--365, Taipei, Taiwan (2000.12) [PDF file(143KB) ]

4. Sylvain Descamps and Mitsuru Ishizuka:
   Bringing Affective Behavior to Presentation Agents,
   Proc. 3rd Int'l Workshop on Multimedia Network Systems (MNS2001) (IEEE Computer Soc.), pp.332-336, Mesa, Arizona, (2001.4) [PDF file(133KB)]

5. Sylvain Descamps, Helmut Prendinger and Mitsuru Ishizuka:
   A Multimodal Presentation Mark-up Language for Enhanced Affective Presentation,
   Advances in Education Tecnologies: Multimedia, WWW and Distant Education (Proc. Int'l Conf. on Intelligent Multimedia and Distant Learning (ICIMADE-01), Fargo, North Dakota, USA), pp. 9-16,(2001.6). [PDF file(315KB)]

6. S. Saeyor, H. Binda, and M. Ishizuka:
   Visual Authoring Tool for Presentation Agent Based on Multimodal Presentation Markup Language,
   Proc. Information Visualisation (IV2001), pp. 563-567, London, England, July 2001. [PDF file(212KB)]

7. Peng Du and Mitsuru Ishizuka:
   Dynamic Web Markup Language (DWML) for Generating Animated Web Pages with Character Agent and Time-control Function, Proc.(CD-ROM) 2001 IEEE Int'l Conf. on Multimedia and Expo (ICME2001), 4 pages, Tokyo, Japan, (2001.8) [PDF file(180KB)]

8. H. Prendinger and M. Ishizuka:
   Let's Talk! Socially Intelligent Agents for Language Conversation Training, IEEE Trans. on System, Man and Cybernetics, Part A, Vol.31, Issue 5, pp.465--471 (Sep., 2001) [PDF file(212KB)]

9. Istvan Barakonyi, Mitsuru Ishizuka:
   A 3D Agent with Synthetic Face and Semiautonomous Behavior for Multimodal Presentations,
   Proc. Multimedia Technology and Applications Conf. (MTAC2001, IEEE Computer Soc.), pp.21-25, Irvine, California, USA, November 2001. [PDF file(248Kb)]

10. Sylvain Descamps, Istvan Barakonyi, Mitsuru Ishizuka:
    Making the Web Emotional: Authoring Multimodal Presentations Using a Synthetic 3D Agent,
    Proc. OZCHI-2001 (Computer-Human Interaction, SIG of Australia), pp.25-30, Perth, Australia, Nov. 2001. [PDF file(247Kb)]

11. Istvan Barakonyi, Naiwala P. Chandrasiri, Sylvain Descamps, Mitsuru Ishizuka:
    Communicating Multimodal Information on the WWW using a Lifelike, Animated 3D Agent, Workshop Notes: Int'l Workshop on Lifelike Animated Agents -- Tools, Affective Functions, and Applications (in conjinction with PRICAI-02, Tokyo), pp.16--21 (2002.8) [PDF file]

12. H. Prendinger, S. Descamps, and M. Ishizuka:
    Scripting affective communication with life-like characters in web-based interaction systems. Applied Artificial Intelligence, Vol.16, Nrs.7--8, pp.519--553, 2002. [PDF file (draft)]

13. Naoaki Okazaki, Sohei Aya, Santi Saeyor, and Mitsuru Ishizuka:
    A Multimodal Presentation Markup Language MPML-VR for a 3D Virtual Space,
    Workshop Proc. (CD-ROM) on Virtual Conversational Characters: Applications, Methods, and Research Challenges (in conjunction with HF2002 and OZCHI2002), Melbourne, Australia, (2002.11). [PDF file]

14. Naiwala P. Chandrasiri, Istvan Barakonyi, Takeshi Naemura, Mitsuru Ishizuka and Hiroshi Harashima:
    Communication over the Internet using a 3D Agent with Real-time Facial Expression Analysis, Synthesis and Text to Speech Capabilities, Proc.(CD-ROM) IEEE Int'l Conf. on Communication Systems (ICCS 2002), paper no. 479 (5 pages), Singapore (2002.11) [PDF file]

15. Kyoshi Mori, Adam Jatowt and Mitsuru Ishizuka:
    Enhancing Conversational Flexibility in Multimodal Interactions with Embodied Lifelike Agents, Proc. Int'l Conf. on Intelligent User Interfaces (IUI 2003) (ACM), pp. 270--272, Miami, Florida, USA (2003.1) [PDF file]

16. Santi Saeyor, Koki Uchiyama, Mitsuru Ishizuka:
    Multimodal Presentation Markup Language on Mobile Phones, AAMAS Workshop Proc. (W10) - Embodied Conversational Characters as Individuals, (in conjunction with Second Int'l Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS-03)), Melbourne, Australia, pp.68-71, (2003.7) [PDF file]

17. Helmut Prendinger and Mitsuru Ishizuka:
    Designing and evaluating animated agents as social actors. IEICE Transactions on Information and Systems, Vol.E86-D, Nr. 8, 2003, pp. 1378-1385, (2003.8) [PDF file]
    
    
18. Santi Saeyor, Suman Mukherjee, Koki Uchiyama and Mitsuru Ishizuka:
    A Scripting Language for Multimodal Presentation on Mobile Phones, Intelligent Virtual Agents (Proc. 4th Int'l Worshop, IVA2003, Kloster Irsee, Germany) (T. Rist, R. Aylett, D. Ballin, J. Rickel (eds.)), Springer, LNAI-2792, pp.226-230 (2003.9) [PDF file]

19. Zhenglu Yang, Nakasone Arturo, Adam Jatowt, and Mitsuru Ishizuka:
    A Two-Model Framework for Multimodal Presentation with Life-like Characters in Flash Medium, Proc. of 7th IASTED Int'l Conf. on Software Engineering and Applications (SEA 2003), Marina del Rey, CA, USA, pp.769-774 (2003.11) {IASTED Best Paper Award in the area of Software Quality and Testing} [PDF file]

20. Helmut Prendinger and Mitsuru Ishizuka (eds.):
    Life-like Characters -- Tools, Affective Functions, and Applications ,
    Springer-Verlag (Cognitive Technologies series), (2004) (ISBN: 3-540-00856-5)
    [ Springer's Online Catalog] [ Online materials for book chapters at the VHML site]

21. Helmut Prendinger and Mitsuru Ishizuka:
    Introducing the Cast for Social Computing: Life-like Characters, in "Life-like Characters" (see above), pp.3-16 (2004) [PDF available as a sample from Springer]

22. Helmut Prendinger, Santi Saeyor, and Mitsuru Ishizuka:
    MPML and SCREAM: Scripting the Bodies and Minds of Life-like Characters, in "Life-like Characters" (see above), pp.213-242 (2004)

23. Helmut Prendinger, Junichiro Mori, Santi Saeyor, Kyoshi Mori, Naoaki Okazaki, Yustinus Juli, Sonja Mayer, Hiroshi Dohi, and Mitsuru Ishizuka:
    Scripting and evaluating affective interactions with embodied conversational agents, KI Zeitschrift (German Journal of Artificial Intelligence), Vol.1, pp.4-10 (2004.2) [PDF file]

24. Zhenglu Yang and Mitsuru Ishizuka:
    MPML-FLASH: A Multimodal Presentation Markup Language with Character Agent Control in Flash Medium, Proc. of 6th Int'l Workshop on Multimedia Network Systems and Applications (MNSA'2004), Tokyo, Japan, pp.187-192, (2004.3) [PDF file]

25. Helmut Prendinger, Sylvain Descamps, and Mitsuru Ishizuka:
    MPML: A markup language for controlling the behavior of life-like characters, Journal of Visual Languages and Computing, Vol.15, Nr.2, pp.183-203 (2004.4). [PDF file]

26. Helmut Prendinger and Mitsuru Ishizuka:
    What Affective Computing and Life-like Character Technology Can Do for Tele-Home Health Care. Workshop on HCI and Homecare: Connecting Families and Clinicans (Online Proceedings), in conj. with CHI-04, Vienna, Austria (2004.4). [PDF file]

27. Helmut Prendinger, Hiroshi Dohi, Hua Wang, Sonja Mayer, and Mitsuru Ishizuka:
    Empathic Embodied Interfaces: Addressing Users' Affective State. Tutorial and Research Workshop on Affective Dialogue Systems (ADS-04), Kloster Irsee, Germany, pp.53-64 (2004.6) [PDF file]

28. Yasubumi Nozawa, Hiroshi Dohi, Hitoshi Iba and Mitsuru Ishizuka:
    Humanoid Robot Presentation Controlled by Multimodal Presentation Markup Language MPML, Proc. 13th IEEE Int'l Workshop on Robot and Human Interactive Communication (RO-MAN2004), Kurashiki, Japan, No.026 (2004.9) [PDF file]

29. Helmut Prendinger, Junichiro Mori, and Mitsuru Ishizuka:
    Using Human Physiology to Evaluate Subtle Expressivity of a Virtual Quizmaster in a Mathematical Game, Int'l Journal of Human-Computer Studies, Vol.62, pp.231-245 (2005). [PDF file]

30. Helmut Prendinger, Chunling Ma, Junichiro Mori, and Mitsuru Ishizuka:
    Does Non-verbal Behavior of an Embodied Agent Matter? , Proc. 2005 Int'l Conf. on Active Media Technology (AMT-05), IEEE, Takamatsu, Kagawa, Japan, pp.535-540 (2005.5) [PDF file]

31. Helmut Prendinger, Chunling Ma, Jin Yingzi, Kazutaka Kushida, and Mitsuru Ishizuka:
    Evaluating the Interaction with Synthetic Agents using Attention and Affect Tracking (Poster Session), Proc. 4th Int'l Conf. on Autonomous Agents and Multi Agent Systems (AAMAS-05), Vol.3, pp.1099-1100, Utrecht, The Netherlands (2005.7). [PDF file]

32. Kazutaka Kushida, Yoshitaka Nishimura, Hiroshi Dohi, Mitsuru Ishizuka, Johane Takeuchi and Hiroshi Tsujino:
    Humanoid Robot Presentation through Multimodal Presentation Markup Language MPML-HR, 4th Int'l Conf. on Autonomous Agents and Multi Agent Systems (AAMAS-05) Workshop 13 "Creating Bonds with Humanoids", pp.23-29, Utrecht, The Netherlands (2005.7) [PDF file]

33. Chunling Ma, Helmut Prendinger and Mitsuru Ishizuka:
    Emotion Estimation and Reasoning Based on Affective Textual Interaction,
    in Affective Computing and Intelligent Interaction, First Int'l Conf. ACII 2005 (J. Tao, T. Tan and R. W. Picard (Eds.)), Springer LNCS 3784, Beijing, China, pp.622-628 (2005.10) [PDF file]

34. Shaikh Mostafa Al Masum, Mitsuru Ishizuka and Tawhidul Islam:
    Creating Topic-Specific Automatic Multimodal Presentation Mining the World Wide Web Information, Proc. 8th Int'l Conf. on Computer and Information Technology (ICCIT 2005), Dhaka, Bangladesh, pp.267-272 (2005.12) [PDF file]

35. Yoshitaka Nishimura, Kazutaka Kushida, Hiroshi Dohi, Mitsuru Ishizuka, Johane Takeuchi and Hiroshi Tsujino:
    Development and Psychological Evaluation of Multimodal Presentation Markup Language for Humanoid Robots, Proc. 5th IEEE-RAS Int'l Conf. on Humanoid Robots, Tsukuba, Japan, pp.393-398 (2005.12) [PDF file]

36. Mitsuru Ishizuka and Helmut Prendinger:
    Describing and Generating Multimodal Contents Featuring Affective Lifelike Agents with MPML (invited paper), New Generation Computing, Vol.24, No.2, pp.97-128 (2006.2) [PDF file(scanned, 3.4MB)]

Back to Homepage of Ishizuka Lab.

Web Administrator ( www-admin@miv.t.u-tokyo.ac.jp) // Ishizuka Lab