Skip to main content

Table 1 Multimodal matrix

From: Air–ground integrated artificial intelligence of things with cognition-enhanced interference management

Function

Visual

Speech

Sensor

Text

Camera

1

0

0

0

Identifying objects

1

1

1

1

Image

1

0

0

0

Sound

0

1

1

0

Emotion recognition

1

1

0

1

Status

1

1

1

1

  1. Based on the 0-1 states in the matrix, suitable eigenvalues that can serve as normalization features in multimodal matrices can be obtained
  2. 1 indicates that the mode can be detected
  3. 0 indicates that the mode cannot be detected