Department of Information and Communication Engineering Graduate School of Information Science and Technology University of Tokyo See Iba Lab. from this link. English   Japanese   Japanese(2)

---

Jump to | top | address | research topics | publications | members | related |

Address & Contact (Ishizuka Lab.)

• Address: 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, JAPAN
• Location: Hongo (Main) Campus, Eng. Bldg. 2, 11th floor
  --- Picture(Eng. Bldg. 2) | Guide Map | Accesses to the Hongo Campus
• Phone: +81-3-5841-6774 (Room 111C1), +81-3-5841-6755 (Room 111D1)
• Fax: +81-3-5841-8570
• Email: (please see our member list shown below.)

Multimodal Anthropomorphic (Lifelike) Agent and Multimodal Content Description Language

As a promising new style of human interface beyond currently dominating GUI (Graphical User Interface), we are working on a research & development of a multimodal anthropomorphic interface agent called VSA (Visual Software Agent), which has a realistic moving face, a vision function, speech communication capability and an access function to inoformation sources in the Internet. The VSA, which is technically realized by integrating several technologies such as realtime image synthesis/recognition, speech recognition/synthesis, dialogue management, access technologies to the Internet and WWW (World Wide Web), etc., enables a friendly multimodal human interface environment close to daily face-to-face dialogue. We have constructed an experimental guidance system with this VSA system and multimedia presentation. An important technology that has made VSA very practical is connections with WWW browsers (initially Mosaic, then Netscape). With this connection, we can access vast WWW information sources through speech dialogues with our VSA as well as mouse operations.
Since 1998, not only as an interface but also as an attractive multimodal content creation tool, we are developing MPML (multimodal presentation markup language) and its related systems using animated character agents.

• Anthropomorphic Interface Agent with face, eye, ear, mouth and intelligence (VSA:visual software agent) [ Overview Paper (HTML) -- totally 2MB ]
• Computer Graphics for Realistic Human Face
• Realtime Computer Vision for Human Interface
• Speech Dialogue Management
• VSA as an interface agent to Intenet WWW Information Space
  (VSA w/ WWW Browsers photos), [ VSA connected with Netscape (HTML)]
• Realistic Moving CG Fish (CG-Fish photo)
• CG Hair Syntesis based on Wisp Model ( Aminating Demo -- wait some minutes)
  (If the above link does not work, try this one.)
• Parallel Visual Computing System:TN-VIT (TN-VIT photo)
• MPML: Multimodal Presentation Markup Language
  (See also MPML Page written by Robin Cover (2000.8.9))
  
• Slides of MPML-rerated Researches | Demo Video: MPML3.0 with SmArt Agents (avi file, 15MB)
• MPML-VR: 3D(VRML) space version
• MPML-mobile version
• Language Training System using Animated Agents
• Emotion-rich Lifelike Agent Characters -- AmArt Agent, etc.
• Artificial Emotion, Affective Interface using Bio-sensors
• Conversational Flexibility combined with a chatbot, ALICE

• Textual Affect Sensing -- presentation file 2012 (4.1MB)

Internet / Web Intelligence

With the progress of the Internet and multimedia technologies, our information space is becoming rich both in quantity and quality. Although stimuli or inputs from rich information sources are indispensable for activating our human brains, it become to impose unnecessary loads for extracting useful information if the information space is disordered with heterogeneous necessary and unnecessary information. This study aims at constructing an information mediation space or mediation mechanism which allows to provide useful reorganized information in a friendly manner. We have so far developed a navigation agent mechanism for hyper-linked WWW space. Researches such as an automatic meaning recognition scheme for hyper links in the WWW, a reorganization scheme of the WWW information space, and a software robot for finding meaningful changes in the WWW are now going on.
Recently, we are also intensively working on text processing for making the WWW intelligent, such as on keyword extraction, text summarization, question answering, etc. Some original and useful techniques have been invented to date, and are emerging.

• WebBeholder (test service available) : A WWW agent for finding meaningful changes in the Web Pages
• FishEye Matching & FishView System: A Support System for Viewpoint-based Sorting of Large Document Data (display image)
• Understanding the Meaning of Hyper-links (display image)
• Analysis & Understanding Web Pages and their Relations
• Weak-organization of WWW info. space and AreaView system
• Text Processing for Making WWW Intelligent -- Keyword Extraction, Text Summarization, Question Answering, etc.
• Human Network constraction from WWW
• Chance Discovery in WWW
• Computing Relational Similality between Entity Pairs on the Web
• Latent Relational Search Engine
          Demo Site ---   YouTube Video (English version) | YouTube Video (Japanese version)
• Semantic Computing in WWW info. space

Artificial Intelligence Mechanisms

Toward advanced artificial intelligence functions beyond currently available deductive inference, we have carried out basic researches to enhance knowledge-base capability in terms of handling incomplete knowledge with inconsistency. In particular, we have worked on hypothetical reasoning or abduction, and invented an efficient inference method which can find a near-optimal solution in a low-order polynomial time. This method called networked bubble propagation (NBP) method is now available as a free software. We are also working on efficient methods for weighted constraint satisfaction problems (weighted CSP).

• Fast Hypothetical Reasoning Mechanisms
  • Hypotetical Reasoning using Inference-path Network
  • Hypotetical Reasoning using Analogy
  • Speedup of Hypothetical Reasoning by Experience-based Learning
  • Knowledge Compilation & Reformation
  • Polynomial-time Cost-based Hypothetical Reasoning employing an Approximate Solution Method of 0-1 Integer Programming
  • Networked Bubble Propagation (NBP) Method as a Polynomial-time Cost-based Hypothitical Reasoning
    [ NBP1, NBP2 (free softwares)]
  • SL(slide-down and lift-up) Method jointly using Linear and Nonlinear Programming Methods
  • Predicate-logic Hypothetical Reasoning based on Fast Propositional-level Reasoning Mechanism -- HYPER system
• Efficient Constraint Solving using BDD (Binary Decision Diagram) and its Application to Understanding of Three Orthographic Views
• Efficient Methods for Weighted Constraint Satisfaction Problem (weighted CSP)
• Inductive Logic particularly for Recursive Descriptions
• Learning Agent
• KRNL(Knowledge Representation for Natural Language): A Knowledge Representation Scheme fitted to Natural Language

Evolutionary Computation, Genetic Programming

Please see Iba-lab. page for this research topic.

Jump to | top| address | research | publications | members | related |

Alumni (partial list)

• Akinori Abe ('91 Dr.) --- ave @ atr.jp
• Wiwat Wongwarawipat ('91 Dr.) --- (wiwat @ nst-ep.com <== old)
• Toshirou Makino ('92 Dr.) --- makino @ cslab.kecl.ntt.co.jp
• Chil-Woo Lee ('92 Dr.) -- leecw @ chonnam.ac.kr
• Osamu Hasegawa ('93 Dr.) --- hasegawa @ isl.titech.ac.jp
• Xing-jian Xu ('94 Dr.) --- KHB02623 @ niftyserve.or.jp
• Yukio Ohsawa ('95 Dr.) --- ohsawa @ q.t.u-tokyo.ac.jp
• Ying-Jieh Huang ('96 Dr.)
• Edison Satoshi Gomi ('96 Dr.) --- gomi @ pcs.usp.br
• Cai Dongfeng ('98 Dr.) --- cai_df @ 163.com
• Chen Lieu-Hen ('98 Dr.) --- lhchen @ csie.ncnu.edu.tw
• Yasufumi Takama ('99 Dr.) --- ytakama @ cc.tmit.ac.jp
• Itsuro Saito ('00 Dr.) --- saito @ bme.rcast.u-tokyo.ac.jp
• Yutaka Matsuo ('02 Dr.) --- matsuo @ biz-model.t.u-tokyo.ac.jp
• Naohiro Matsumura ('03 Dr.) --- matumura @ econ.osaka-u.ac.jp
• Hironori Tomobe ('04 Dr.) -- tomobe @ nagao.nuie.nagoya-u.ac.jp
• Khoo Khyou Bun ('04 Dr.) --- kbkhoo_jp @ yahoo.co.jp
• Santi Saeyor ('99.9 Dr., -'04 Research Associate) --- santi @ hottolink.co.jp
• Helmut Prendinger ('98-'00 Post Doc., -'04 Research Associate) --- helmut @ nii.ac.jp
• Adam Jatowt ('05 Dr.) --- adam @ dl.kuis.kkyoto-u.ac.jp
• Naoaki Okazaki ('07 Dr.) -- okazaki @ is.s.u-tokyo.ac.jp
• Yoshitaka Nishimura ('07 Dr.) --- mimail @ goopat.sakura.ne.jp
• Masahiro Ono ('07 Dr.) --- ono @ fb3.so-net.ne.jp
• Hua Wang ('07 Dr.) --- wanghua24 @ gmail.com
• Junichiro Mori ('07 Dr.) --- junichiro.mori @ gmail.com
• Mostafa Al Masum Shaikh ('08 Dr.) --- almasum @ gmail.com
• Arturo Nakasone ('08 Dr.) --- arturo.nakasone @ gmail.com
• Jie Yang ('08-Sept. Dr.) --- midi.jie.yang @ gmail.com
• Yingzi Jin ('09 Dr.) --- yzjin2006 @ gmail.com
• Tadanobu Furukawa ('09 Dr.) --- tfuru.lab @ gmail.com
• Danushka Bollegala ('09-Sept. Dr.) -- danushka.bollegala @ gmail.com
• Yulan Yan ('10 Dr.) -- yulan @ nict.go.jp
• Werner Breitfuss ('10 Dr.) -- Werner_Breitfuss @ gmx.net
• Hugo Hernault ('11 Dr.) -- hugo.hernault @ gmail.com
• Alena Neviarouskaya ('11 Dr.) -- a.neviarouskaya @ gmail.com
• Haibo Li ('11 Dr.) -- lihaibo.c @ gmail.com
• Nguyen Tuan Duc ('12 Dr.) -- duc @ milresh.com
• Farghaly Mamdouh Farouk Mohamed ('12-Sept. Dr.) -- mamfarouk @ hotmail.com
• Tacoa Renevey Francisco Antonio ('13 Dr.)

• Graduate School of Information Science and Technology | School of Engineering
• Dept. of Information and Communication Eng. | Dept. of EE
• University of Tokyo

Jump to | top| address | research | publications | members | related |