Function | Visual | Speech | Sensor | Text |
---|
Camera | 1 | 0 | 0 | 0 |
Identifying objects | 1 | 1 | 1 | 1 |
Image | 1 | 0 | 0 | 0 |
Sound | 0 | 1 | 1 | 0 |
Emotion recognition | 1 | 1 | 0 | 1 |
Status | 1 | 1 | 1 | 1 |
- Based on the 0-1 states in the matrix, suitable eigenvalues that can serve as normalization features in multimodal matrices can be obtained
- 1 indicates that the mode can be detected
- 0 indicates that the mode cannot be detected