![]() |
|||
![]()
|
![]() |
![]() |
![]() |
3.2.1.2. Support to the Consultation Environment Improving user dialogue. In most ES, the dialogue between the system and the user is done via the keyboard with the system asking questions (frequently by showing menus and prompting questions) and the user providing answers. MM enhances this dialogue (MM 4 in Figure 4), for example, by asking questions while the person who answers appears on the computer screen. User replies are currently entered via the keyboard; however, as speaker-independent voice recognition systems become more effective and economical, verbal system inputs will become feasible. Users can then ask for and receive verbal or other appropriate MM explanations. Displaying results. ES primarily provide advice to users. This includes diagnoses and suggestions on ways to correct an equipment problem; for example, appropriate repair procedures are identified, retrieved, and displayed during a troubleshooting dialogue. When complex equipment is involved, the advice will be supported either individually or in combination with schematics, drawings, still and full-motion pictures and audio instructions (MM 4 in Figure 4). Another way to display results is by developing special interface designs that are enhanced by MM; this will provide effective means of accessing MM database information. These types of support are also very important for intelligent computer-based training instruction and remediation. Providing explanations. While displaying results and providing recommendations are essential features of ES, MM supplements explanations of "why?" "why not?" and "what if?" user questions (MM 5 in Figure 4). Examples include supporting graphs (e.g., trend lines), display of pictures (still and motion), or graphical comparisons of alternatives. This functionality provides HM explanations for knowledge-based equipment diagnosis applications. The HM user interface includes template-based text, graphics, and icons that represent linked objects. These objects communicate by messages and use a standard, object-oriented programming approach. Another advantage of MM-enhanced explanation capabilities is the potential to increase user system acceptance. 3.2.2. MM Supported by ES The idea of making MM more intelligent has been pursued for several years in commercial and university research laboratories. In recognition of this important topic, the American Association for Artificial Intelligence (AAAI) organized a special (and pioneering) "Intelligent Multimedia Interfaces" workshop at their Ninth National Conference (AAAI Proceedings, 1991). Various research topics and applications were identified and discussed during this workshop. In the following situations, MM presentation is the primary objective of the integrated system with intelligent support provided by an ES component. 3.2.2.1. Support to the Mix of Media Tools and/or Their Output ES technology can assist users in selecting, retrieving, and manipulating MM information. For example, a system that reasons in detail about user needs or about the meaning of viewer questions and is then able to choose intelligently among media alternatives available to the user for improved presentations and response. Once this type of system becomes economically feasible, it could be added, for example, to executive information systems (EIS) for the purpose of providing a personal touch, which is considered important to some executives. 3.2.2.2. Design of Appropriate Mix of Text and Graphics An ES combined with a natural language processor to support a mix of text and graphics development, layout, and presentation was developed by Wahlster, Andre', Graf, and Rist (1991). The result is a variety of customized MM documents for the intended audience and situation. The system is composed of a presentation planner and text generator and a layout manager and graphics generator. All components are guided by an embedded ES knowledge base. 3.2.2.3. Using an ES as a Guide for HM HM may contain highly sophisticated textual, graphic, image, or motion forms of knowledge. While the user of an HM system has complete freedom of navigation, a systematic procedure to navigate through the accumulated knowledge does not exist. The objective of the system determines the quality of navigation requirements. If the goal is learning or exploration, the results can be excellent. If specific knowledge is the objective, the user may inadvertently navigate around (and therefore miss) important points of information. ES can be used to explore knowledge by presenting the user with options or by evaluating user inputs. The system then branches to an appropriate portion of the knowledge base and presents other options to the user. This process continues until a conclusion is reached or a recommended option list is presented. In this way, all the critical knowledge components are touched with pre-defined, mapped, or guided navigation. By merging ES and HM, the user is guided so that a complete use of the HM system is achieved. 3.2.3. Complementary Integration (Joint-Venture) In the previous configurations, either the ES played the major role and MM supported it, or vice versa. However, the two technologies can be used independently to perform different tasks of the same job. Thus, instead of supporting each other as in previous software architectures, they complement each other. Such a combination is likely to occur in complex systems where the ES itself is integrated with other computer-based information systems (e.g., databases or complex applications). In these systems, the MM can be part of the application itself (e.g., displaying MM educational material) while the ES performs some advisory or monitoring task (e.g., determining student learning style preference and identifying the best type of presentation material or providing remediation guidance). In this complementary manner, ES/MM integration will be expanded to include other computer-based and database-oriented information systems. 3.3. AN EVOLUTION OF SYSTEM INTEGRATION MODELSSoftware architectures and integration orientations have been identified in previous discussions. Figure 5 integrates these design considerations and illustrates a spectrum of system integration models: past, present, near-term, and future. This phased evolution of system synergy serves as a framework for subsequent analysis and discussion. While Figure 5 may not include all possible combinations of the focus technologies (ES, MM, HM, and IM), it does provide a perspective of the breadth and scope of major design considerations and integration possibilities. Other model variations will, of course, evolve in the future.
|
![]() |
|
Use of this site is subject certain Terms & Conditions. Copyright (c) 1996-1999 EarthWeb, Inc.. All rights reserved. Reproduction in whole or in part in any form or medium without express written permission of EarthWeb is prohibited. Please read our privacy policy for details. |