The future form of human-computer interface in virtual reality
2026-04-06 07:36:46··#1
Abstract: Virtual reality (VR) provides users with an immersive and multi-sensory experience. As a future form of human-computer interaction, VR technology holds greater promise than any previous form of human-computer interaction for achieving a truly harmonious, "human-centered" human-computer interface. This paper explores the characteristics and key technologies of VR human-computer interfaces, focusing on solving the main problem of future interface design—interface model establishment. Keywords: VRML, Virtual Reality, Human-Computer Interface, Interaction, Virtual Reality Technology 1 Introduction Will graphical user interfaces be replaced by new interfaces? What will the next generation of user interfaces look like? These are questions that many people are interested in. When you're feeling down, if you want to feel the sea breeze, hear the waves, see snow-capped mountains, watch flowing streams, and open your bedroom window, no matter where you are! It will do all this for you. Virtual reality (cyberspace) is a computer-generated, real-time representation of a world that simulates human senses; it is sometimes also called virtual reality (VR). Here, "world" refers to realistic three-dimensional graphics; it can be a realistic reproduction of a specific real world or a purely imagined world. Operators can interact with it through vision, hearing, touch, force, etc., so as to generate an "immersive" scene. 2 Human-computer interaction interface in virtual reality system. 2 Human-computer interaction interface in virtual reality system2.1 Basic concept (Cyberspace) Virtual reality is a new form of human-computer interface. It generates a virtual environment (simulation of physical reality) through computers and other interactive devices, so that participants have a "immersive" feeling and can communicate with objects in the simulated world using human natural skills and perception. Virtual reality has three most prominent features, namely the "3I" characteristics that people praise: interactivity, immersion and imagination [1]. The application prospects are very broad. It first appeared in television, games and entertainment industry. The current application focus is shifting to industry and commerce. 2.2 Interface features The main features of the new generation interface can be described as follows: (1) User-centered Taking the changes in user needs for the interface as the starting point, the external form and internal mechanism of the user interface can meet the needs of different users. This is the user-centered design idea. Person-independent continuous speech recognition technology will enable computers to understand people's requirements and is an important input interface and means. Fisheye technology magnifies the content near the screen observation (or cursor) position, making it easier for users to observe. In traditional human-computer systems, people are considered operators and adapt to machines; in general human-computer systems, people are called users and can talk to machines, but have no active control ability; while in virtual reality systems, people are active participants and machines will react to various human actions. (2) Multimodality Multimodality interfaces aim to make full use of the complementary characteristics of more than one sensory and motor channels to capture the user's intentions, thereby enhancing the naturalness of human-computer interaction. Human sensory channels include vision, hearing, touch, smell and balance; human motor channels include hands, mouth, eyes, head, feet and body. Now, when operating a computer, people's eyes and hands are very tired and the efficiency is not high. If listening, speaking, and hand and eye actions are combined and interacted in a multi-channel, natural way, efficient human-computer communication can be achieved. The best response channel can be selected by the human or the machine, so that no channel is overloaded. (3) Non-precise precise interaction technology refers to an interaction method that can fully explain the user's interaction purpose with a single technology. Both the keyboard and mouse require precise input from the user. However, people's actions or thoughts are often not very precise. The computer should understand the user's requirements and even correct the user's mistakes. Intelligent interface is an important direction. (4) High bandwidth The content output by the computer can now display color images quickly and continuously, and its information content is very large. However, people still use the keyboard to type one by one. Therefore, the input bandwidth of the computer is very low. The next generation of user interface should support high input bandwidth and input information quickly and in large quantities. Input and understanding of voice, images and gestures are the future development direction. (5) No location restriction At present, computers are mainly used in offices, laboratories or homes. People operate in front of the computer screen. This operation method limits the application of computers. Although remote controls can replace some actions, viewing the screen with a telescope seems inconvenient. However, using voice input/output or other computer vision (camera input) technologies can overcome location limitations. 3. Establishment of Virtual Reality Models A future interface will allow end-users to fully immerse themselves in their work without expending energy on interface operation, and even enter a virtual world completely identical to reality. Therefore, establishing such a model is crucial. The model discussed below combines user characteristics and fully utilizes the basic theoretical knowledge of virtual reality systems and human-computer interfaces, key technologies of multi-channel user interfaces, VRML, software engineering, knowledge engineering prototyping methods, and other related knowledge. Ideally, the establishment of the interface model can be divided into three main steps: ① Establishment of the role model; ② Establishment of the target model; ③ Establishment of the working model. These will be discussed separately below. 3.1 Establishment of the Role Model The role model includes the important characteristics of the user. Generally, it is difficult to model each user, but by introducing "roles," the important characteristics of different users can be concentrated in one person. We can use each role to represent a type of user. Generally, it is difficult to use one role to represent all users. To easily distinguish each role, each role should be given an appropriate name and a suitable description. 3.2 Establishing the Goal Model The goal model is a priority list of tasks to be completed. Each task has its own goal, which includes multiple aspects, each with a different priority level. Designing the user interface involves choosing from different design options. Knowing the user's most important task will make this selection easier. To determine the most important task for each role, we can assign a weight to the priority of each task for that role. Generally, 2-3 of the highest priority tasks can be selected. The user interface should allow users to easily complete these tasks. However, there may be serious conflicts in the priority levels of various roles. In this case, the total time spent using the computer and related platforms by each role, as well as the importance of the role, can be used as criteria to determine which task is the most important. 3.3 Establishing the Work Model The work model is a description of the user's work and the required information and operations. 3.3.1 Workset: A workset refers to the sum of a series of related tasks that a role needs to complete, without any order requirement. Within an organization, each employee is responsible for certain tasks; these responsibilities are described here as work sets. For example, a salesperson's responsibilities can be described as a work set consisting of selling and checkout. The tasks within a salesperson's work set fall into the category of routine tasks. 3.3.2 Information Objects and Methods: Each role's work set is closely related to information. When designing the interface, it should always be kept in mind that users should be able to easily access the information they need. Users' information needs and expected functions can be defined as information objects and methods. To ensure that no requested information is missed, information objects and methods should be described using the user's work terminology rather than computer terminology. To define information objects, a relatively complete data model is needed. Each instance within the work set can be defined as several information objects, and there can be inheritance and association relationships between information objects. The functional requirements for information processing can be described using the method of associating task set instances with information objects. 3.3.3 Number of Objects, Attributes, and Operations In VRML, the class model defines the attributes and methods of each class (similar to object-oriented languages). However, some attributes related to interface design are not fully described in the data model. To ensure user satisfaction, these attributes should be described in detail. We know that users sometimes need to observe the same information from different perspectives simultaneously. Therefore, when designing the interface, the information objects involved in completing a task should be clearly understood. Understanding the operational characteristics of information objects is also crucial. Knowing which operations users frequently use allows for the implementation of shortcut keys, saving user time and making the interface more realistic. 3.3.4 Coordinating Relevant Personnel Users, interaction device designers, and software engineers play different roles in interface design. Interaction device designers act as a bridge between users and software engineers and should be responsible for coordinating the relationship between the three. Only in this way can the type of human-computer interaction be determined, resulting in a realistic virtual world. Users are experts in their respective industries, and interaction device designers should interact with users frequently, ideally understanding the task characteristics and psychological traits of users while they are working. This is more conducive to grasping the key points and reflecting them in the interface design in a realistic and practical way. Software engineers are the final implementers of human-computer interfaces. They generally have rich programming experience, but often lack communication with users and experience and common sense in human-computer interface design. Interaction device designers should communicate frequently with software engineers to ensure that the overall realism of the interface is ultimately achieved. 4 Conclusion This paper introduces virtual reality as a future human-computer interface. Through the basic theoretical knowledge of virtual reality systems and human-computer interfaces, key technologies of multi-channel user interfaces, the virtual reality modeling language VRML, software engineering, knowledge engineering prototyping methods, and other related knowledge, a model for the establishment of a virtual reality system human-computer interface is proposed. The characteristic of this model-building method is that the overall architecture is divided into three parts, and after modularization, each part performs its own function, which greatly improves the design speed and the efficiency of practical application. Virtual reality technology is a brand-new comprehensive information technology that emerged at the end of the 20th century. Because it generates a realistic and lifelike environment with harmonious and friendly human-computer interaction, virtual reality technology will transform the dull, rigid, and passive nature of human-computer interaction, immersing people in a captivating and unforgettable work environment. The application and interdisciplinary fields of virtual reality technology are extremely broad, almost all-encompassing and pervasive. The application and industrial development of virtual reality in many areas are driven by strong market demand and powerful technological forces. Its development will fundamentally change people's work and lifestyles.