Multimodal Input

Overview

OpenHarmony provides a Natural User Interface (NUI) for you to interact with your users. Unlike conventional categorization of input methods, OpenHarmony combines input methods of different dimensions into multimodal inputs, so you can easily arm your application with multi-dimensional, natural interaction features by using the application framework and system built-in UI components or APIs.

Specifically, OpenHarmony currently supports traditional input methods such as key and touch inputs.

Directory Structure

/foundation/multimodalinput/input
├── common                       # Common code
├── interfaces                   # External APIs
│   └── native                   # Native APIs
│       └── innerkits            # Native APIs provided for internal subsystems
├── service                      # Service framework code
├── sa_profile                   # Service startup configuration file
├── uinput                       # Input event injection module

Usage

Available APIs of Multimodal Input are event injection ones, which are open only to system apps currently.

Repositories Involved

Multimodal input subsystem

multimodalinput_input