RMIS Leaderboard

We report an overall RMIS score across all datasets, where the higher the score is, the better the model is!

We warmly welcome fellow researchers to test their models on the RMIS benchmark! If you would like to showcase your model on the leaderboard, please provide a minimum inference code and contact us at jab22@mails.tsinghua.edu.cn

Model Performances on the RMIS Benchmark

Model	Variant	Size	RMIS	Anomaly Detection							Fault Diagnosis
				DCASE						Mean	IICA	IIEE	WTPG	MaFaulDa		SDUST		UMGED				PU		Mean
				20	21	22	23	24	25	Mean	IICA	IIEE	WTPG	sound	vib	bearing	gear	sound	vib	vol	cur	vib	cur	Mean
AudioMAE	base	85M	51.61	63.87	54.86	56.34	57.96	55.30	56.82	57.52	58.88	53.89	64.02	47.48	80.95	59.74	98.18	6.91	10.93	10.01	11.59	56.02	35.54	45.70
BEATs	iter3	90M	57.30	74.20	60.50	58.95	63.31	56.93	59.09	62.16	77.93	68.17	70.57	52.87	84.45	62.37	98.23	5.98	10.32	10.95	17.23	74.18	48.42	52.44
EAT	base30	88M	57.62	72.69	58.03	58.84	59.35	56.48	58.65	60.67	64.48	96.65	61.28	68.32	91.90	64.03	95.46	7.89	9.39	12.49	18.87	68.33	50.38	54.57
EAT	large	310M	58.03	73.81	57.06	57.94	60.29	57.78	60.34	61.20	65.80	94.06	68.91	58.47	88.42	62.64	96.32	9.57	11.60	11.22	15.54	75.74	54.73	54.85
CED	tiny	5.5M	55.36	66.99	56.17	56.75	60.09	56.40	58.40	59.15	47.93	74.23	89.43	53.77	84.56	59.02	96.06	8.09	12.96	10.31	12.65	71.50	49.95	51.57
CED	mini	9.6M	55.95	67.48	56.35	56.59	60.05	57.44	58.26	59.36	50.21	84.26	89.26	56.95	84.88	59.24	95.50	8.36	11.66	10.13	12.43	71.50	48.56	52.53
CED	small	22M	56.01	67.50	56.65	56.87	60.76	57.88	58.15	59.63	50.49	80.23	91.20	54.67	84.67	58.00	96.12	8.05	12.15	10.26	13.14	72.89	49.08	52.38
CED	base	86M	56.71	67.60	56.67	56.95	60.99	57.89	58.45	59.76	52.26	90.08	89.20	57.64	85.95	60.20	95.84	8.12	11.57	10.03	13.63	72.14	50.91	53.66
DaSheng	base	85M	56.37	69.25	57.28	56.02	60.95	56.39	55.82	59.28	74.42	99.10	46.84	63.53	92.06	61.37	98.30	5.64	4.45	11.74	20.08	74.93	42.42	53.45
DaSheng	0.6B	630M	55.43	68.35	56.76	55.35	59.85	56.34	55.41	58.68	75.14	99.25	45.41	57.26	91.11	58.23	97.59	5.27	4.28	11.69	14.68	75.78	42.63	52.18
DaSheng	1.2B	1130M	55.91	69.52	57.06	55.82	61.14	56.32	56.01	59.31	73.18	99.00	48.89	58.16	90.79	55.50	97.99	5.42	4.52	11.76	17.32	75.99	44.11	52.51
FISHER	tiny	5.5M	61.12	70.86	58.76	56.40	58.62	53.64	56.37	59.11	85.31	98.72	83.84	75.79	92.58	71.81	99.20	11.90	23.58	21.10	28.24	72.36	56.21	63.13
FISHER	mini	10M	61.43	70.19	58.40	57.62	61.07	54.59	55.75	59.60	86.02	99.05	84.74	75.74	93.20	70.09	98.55	13.69	20.52	22.95	29.97	72.01	55.73	63.25
FISHER	small	22M	62.23	71.04	59.48	59.64	62.63	55.62	58.46	61.15	90.23	98.96	86.77	72.61	95.86	76.35	99.08	12.72	18.35	17.42	25.52	74.90	54.29	63.31

■ Audio Encoders

■ Our Model (FISHER)