Joint modality fusion and temporal context exploitation for semantic video analysis

Papadopoulos, Georgios Th; Mezaris, Vasileios; Kompatsiaris, Ioannis; Strintzis, Michael G.

doi:10.1186/1687-6180-2011-89

EURASIP Journal on Advances in Signal Processing

Table 2 Semantic class association results based on motion information.

From: Joint modality fusion and temporal context exploitation for semantic video analysis

Domain	Measure		R_acc for τ= 0	R_acc for τ= 1	R_acc for τ= 2	R_acc for τ= 3	Method of[33]	Method of[12]	Method of[32]	Method of[27]	Method of[26]
	Class recognition rate (%)	e ₁	99.28	97.83	98.55	97.83	94.93	98.55	89.13	92.03	97.83
		e ₂	75.00	78.85	71.16	73.08	61.54	73.08	34.62	34.62	46.15
		e ₃	34.78	43.48	39.13	34.78	52.17	34.78	21.74	52.17	47.83
		e ₄	60.19	68.25	64.93	65.88	75.83	57.82	54.50	40.76	63.98
Tennis	Overall accuracy (%)		73.35	77.83	75.24	75.47	79.01	71.70	61.56	57.31	71.93
	Average precision (%)		77.33	80.54	79.88	79.03	81.33	69.88	68.57	70.25	70.78
	Frame processing rate (fps)		5.44	5.34	5.33	5.32	1.09	4.89	5.29	5.51	0.91
	Class recognition rate (%)	e ₁	84.75	83.05	86.44	83.05	94.92	86.44	77.97	83.05	69.49
		e ₂	67.86	75.00	75.00	78.57	71.43	57.14	21.43	42.86	25.00
		e ₃	76.44	83.91	81.03	81.03	85.63	66.67	58.62	48.85	68.97
		e ₄	56.25	62.50	56.25	56.25	62.50	56.25	53.13	50.00	62.50
News	Overall accuracy (%)		75.09	80.55	78.84	78.50	83.62	68.60	58.36	55.29	64.16
	Average precision (%)		81.02	84.09	81.94	82.46	85.83	67.02	57.44	68.52	63.09
	Frame processing rate (fps)		5.60	5.49	5.49	5.48	1.03	5.10	5.54	5.70	0.98
	Class recognition rate (%)	e ₁	90.73	90.73	87.42	87.42	94.70	87.42	23.18	72.19	98.01
		e ₂	70.27	81.08	82.43	78.38	85.14	71.62	45.95	79.73	78.38
		e ₃	53.52	64.79	77.46	76.06	59.15	54.93	42.25	47.89	32.39
		e ₄	89.83	89.83	83.05	83.47	88.98	75.42	50.42	31.78	77.97
Volleyball-I	Overall accuracy (%)		82.52	85.53	83.46	82.89	86.09	75.56	40.98	52.07	77.63
	Average precision (%)		83.85	87.10	85.57	84.84	87.33	77.83	48.51	62.51	76.59
	Frame processing rate (fps)		6.04	6.03	6.02	5.96	1.02	5.50	5.94	6.14	0.91
	Class recognition rate (%)	e ₁	84.43	88.52	91.80	86.07	94.26	95.08	24.59	48.36	90.16
		e ₂	88.24	88.24	82.35	82.35	58.82	29.41	70.59	17.65	23.53
		e ₃	76.67	83.33	83.33	71.67	85.00	66.67	60.00	28.33	80.00
		e ₄	47.37	57.89	47.37	52.63	52.63	26.32	15.79	36.84	21.05
		e ₅	74.65	78.87	69.01	77.46	60.56	47.89	22.54	12.68	25.35
		e ₆	63.83	54.26	62.77	65.96	82.98	72.34	6.38	42.55	50.00
		e ₇	52.63	63.16	59.65	54.39	57.89	19.30	12.28	22.81	24.56
Volleyball-II		e ₈	42.86	47.62	42.86	42.86	52.38	19.05	9.52	19.05	23.81
		e ₉	51.95	62.34	57.14	59.74	48.05	25.97	7.79	7.79	33.77
	Overall accuracy (%)		67.84	71.56	70.63	69.70	72.11	56.32	21.93	29.37	51.30
	Average precision (%)		70.03	75.66	71.20	71.70	75.22	56.94	30.50	37.40	51.85
	Frame processing rate (fps)		6.04	6.03	6.02	5.96	1.02	5.50	5.94	6.14	0.91

Numbers in bold indicate the best performance among the considered methods, according to a given measure.

Back to article page