Table 16 The average recall, precision and \(F_{1}\)-score of Ionosphere data depending on the noise level (standard deviation in parentheses)

From: Norm ball classifier for one-class classification

Classifier Training Validation Test
Recall Precision \({F}_{1}\)-score Recall Precision \({F}_{1}\)-score Recall Precision \({F}_{1}\)-score
0%
Two norm 0.991 (0.00) 1.000 (0.00) 0.996 (0.00) 0.982 (0.03) 0.908 (0.07) 0.942 (0.04) 0.973 (0.03) 0.901 (0.06) 0.935 (0.04)
Max norm 0.956 (0.01) 1.000 (0.00) 0.977 (0.01) 0.934 (0.04) 0.961 (0.04) 0.947 (0.03) 0.925 (0.04) 0.969 (0.03) 0.946 (0.03)
One norm 1.000 (0.00) 1.000 (0.00) 1.000 (0.00) 0.978 (0.02) 0.899 (0.06) 0.935 (0.03) 0.969 (0.03) 0.869 (0.06) 0.915 (0.05)
Mix norm 1.000 (0.00) 1.000 (0.00) 1.000 (0.00) 0.991 (0.03) 0.770 (0.09) 0.863 (0.05) 0.996 (0.01) 0.763 (0.09) 0.861 (0.05)
MoG 1.000 (0.00) 1.000 (0.00) 1.000 (0.00) 0.990 (0.03) 0.930 (0.06) 0.958 (0.03) 0.960 (0.05) 0.913 (0.07) 0.933 (0.04)
PDE 0.961 (0.05) 1.000 (0.00) 0.979 (0.02) 0.961 (0.05) 0.932 (0.06) 0.944 (0.03) 0.960 (0.04) 0.932 (0.06) 0.944 (0.03)
1-NN 1.000 (0.00) 1.000 (0.00) 1.000 (0.00) 0.938 (0.04) 0.785 (0.08) 0.853 (0.06) 0.920 (0.06) 0.764 (0.06) 0.832 (0.04)
k-NN 0.928 (0.02) 1.000 (0.00) 0.963 (0.01) 0.900 (0.13) 0.882 (0.07) 0.883 (0.08) 0.878 (0.16) 0.843 (0.07) 0.854 (0.10)
SVDD 0.970 (0.01) 1.000 (0.00) 0.984 (0.00) 0.921 (0.08) 0.902 (0.07) 0.908 (0.05) 0.926 (0.07) 0.899 (0.07) 0.909 (0.05)
5%
Two norm 0.963 (0.01) 0.995 (0.00) 0.979 (0.01) 0.924 (0.07) 0.937 (0.05) 0.928 (0.04) 0.929 (0.06) 0.938 (0.05) 0.931 (0.03)
Max norm 0.998 (0.00) 0.984 (0.00) 0.991 (0.00) 0.965 (0.03) 0.913 (0.08) 0.935 (0.04) 0.956 (0.04) 0.927 (0.08) 0.938 (0.04)
One norm 1.000 (0.00) 0.951 (0.00) 0.975 (0.00) 0.991 (0.01) 0.968 (0.02) 0.980 (0.01) 0.991 (0.02) 0.969 (0.02) 0.980 (0.01)
Mix norm 1.000 (0.00) 0.949 (0.00) 0.974 (0.00) 1.000 (0.00) 0.643 (0.01) 0.783 (0.01) 1.000 (0.00) 0.643 (0.01) 0.783 (0.01)
MoG 0.989 (0.00) 0.996 (0.00) 0.992 (0.00) 0.899 (0.08) 0.954 (0.07) 0.922 (0.05) 0.890 (0.08) 0.950 (0.07) 0.915 (0.05)
PDE 0.961 (0.05) 0.949 (0.00) 0.954 (0.02) 0.961 (0.05) 0.930 (0.08) 0.943 (0.05) 0.960 (0.04) 0.930 (0.08) 0.943 (0.04)
1-NN 1.000 (0.00) 0.949 (0.00) 0.974 (0.00) 0.951 (0.03) 0.773 (0.07) 0.851 (0.05) 0.942 (0.05) 0.762 (0.07) 0.839 (0.03)
k-NN 0.900 (0.02) 0.983 (0.00) 0.939 (0.01) 0.899 (0.10) 0.864 (0.06) 0.875 (0.05) 0.872 (0.10) 0.842 (0.07) 0.853 (0.06)
SVDD 0.949 (0.01) 0.970 (0.01) 0.960 (0.01) 0.863 (0.08) 0.937 (0.07) 0.893 (0.04) 0.863 (0.06) 0.923 (0.07) 0.888 (0.04)
10%
Two norm 0.971 (0.01) 0.987 (0.00) 0.979 (0.01) 0.956 (0.04) 0.917 (0.07) 0.934 (0.04) 0.938 (0.07) 0.904 (0.08) 0.918 (0.06)
Max norm 1.000 (0.00) 0.900 (0.00) 0.947 (0.00) 0.961 (0.03) 0.907 (0.08) 0.931 (0.04) 0.969 (0.03) 0.907 (0.07) 0.935 (0.03)
One norm 0.991 (0.01) 0.980 (0.00) 0.986 (0.00) 0.951 (0.05) 0.902 (0.07) 0.923 (0.04) 0.956 (0.05) 0.876 (0.07) 0.912 (0.05)
Mix norm 0.987 (0.04) 0.904 (0.01) 0.943 (0.01) 0.991 (0.03) 0.655 (0.04) 0.787 (0.02) 0.987 (0.04) 0.651 (0.02) 0.783 (0.00)
MoG 0.991 (0.00) 0.996 (0.00) 0.993 (0.00) 0.899 (0.08) 0.956 (0.06) 0.924 (0.06) 0.899 (0.08) 0.946 (0.06) 0.920 (0.06)
PDE 0.961 (0.05) 0.900 (0.00) 0.929 (0.02) 0.961 (0.05) 0.927 (0.07) 0.942 (0.05) 0.960 (0.04) 0.928 (0.07) 0.942 (0.04)
1-NN 1.000 (0.00) 0.900 (0.00) 0.947 (0.00) 0.951 (0.03) 0.743 (0.05) 0.834 (0.04) 0.942 (0.05) 0.741 (0.04) 0.828 (0.03)
k-NN 0.950 (0.02) 0.962 (0.00) 0.956 (0.01) 0.939 (0.08) 0.813 (0.06) 0.870 (0.06) 0.922 (0.11) 0.812 (0.05) 0.861 (0.07)
SVDD 0.958 (0.01) 0.940 (0.01) 0.949 (0.01) 0.876 (0.08) 0.882 (0.07) 0.876 (0.05) 0.890 (0.07) 0.877 (0.07) 0.880 (0.04)
15%
Two norm 0.968 (0.01) 0.980 (0.01) 0.974 (0.01) 0.956 (0.05) 0.924 (0.06) 0.938 (0.04) 0.942 (0.05) 0.907 (0.10) 0.919 (0.05)
Max norm 0.977 (0.01) 0.987 (0.00) 0.982 (0.00) 0.956 (0.04) 0.925 (0.07) 0.939 (0.04) 0.938 (0.04) 0.933 (0.08) 0.934 (0.05)
One norm 0.991 (0.01) 0.951 (0.01) 0.971 (0.01) 0.991 (0.02) 0.871 (0.08) 0.925 (0.05) 0.982 (0.03) 0.852 (0.09) 0.910 (0.05)
Mix norm 0.997 (0.01) 0.858 (0.03) 0.922 (0.01) 1.000 (0.00) 0.656 (0.04) 0.792 (0.03) 1.000 (0.00) 0.651 (0.02) 0.788 (0.02)
MoG 0.989 (0.00) 0.996 (0.00) 0.992 (0.00) 0.899 (0.08) 0.948 (0.06) 0.920 (0.06) 0.890 (0.08) 0.956 (0.06) 0.919 (0.06)
PDE 0.961 (0.05) 0.849 (0.00) 0.901 (0.02) 0.961 (0.05) 0.927 (0.06) 0.943 (0.05) 0.960 (0.04) 0.927 (0.06) 0.943 (0.05)
1-NN 1.000 (0.00) 0.849 (0.00) 0.918 (0.00) 0.960 (0.03) 0.751 (0.06) 0.841 (0.04) 0.960 (0.04) 0.724 (0.06) 0.825 (0.05)
k-NN 0.957 (0.01) 0.925 (0.01) 0.941 (0.01) 0.934 (0.05) 0.818 (0.07) 0.872 (0.06) 0.907 (0.07) 0.782 (0.06) 0.839 (0.06)
SVDD 0.962 (0.01) 0.904 (0.01) 0.932 (0.01) 0.894 (0.08) 0.853 (0.10) 0.869 (0.07) 0.903 (0.08) 0.853 (0.10) 0.874 (0.07)
20%
Two norm 0.962 (0.01) 0.967 (0.01) 0.964 (0.01) 0.933 (0.05) 0.928 (0.05) 0.929 (0.04) 0.942 (0.06) 0.924 (0.04) 0.932 (0.04)
Max norm 0.994 (0.00) 0.959 (0.01) 0.976 (0.01) 0.970 (0.03) 0.927 (0.05) 0.947 (0.04) 0.956 (0.04) 0.918 (0.06) 0.936 (0.04)
One norm 0.988 (0.01) 0.936 (0.01) 0.961 (0.00) 0.974 (0.03) 0.871 (0.06) 0.918 (0.04) 0.947 (0.07) 0.862 (0.06) 0.899 (0.04)
Mix norm 0.984 (0.04) 0.817 (0.04) 0.891 (0.01) 0.996 (0.01) 0.671 (0.05) 0.800 (0.03) 1.000 (0.00) 0.675 (0.07) 0.804 (0.04)
MoG 0.988 (0.00) 0.995 (0.00) 0.991 (0.00) 0.899 (0.08) 0.944 (0.06) 0.918 (0.06) 0.886 (0.08) 0.943 (0.06) 0.911 (0.06)
PDE 0.961 (0.05) 0.798 (0.00) 0.871 (0.02) 0.961 (0.05) 0.927 (0.05) 0.942 (0.03) 0.960 (0.04) 0.927 (0.05) 0.942 (0.03)
1-NN 1.000 (0.00) 0.798 (0.00) 0.888 (0.00) 0.987 (0.02) 0.689 (0.03) 0.811 (0.02) 0.973 (0.03) 0.686 (0.02) 0.804 (0.01)
k-NN 0.969 (0.01) 0.868 (0.02) 0.916 (0.01) 0.965 (0.04) 0.771 (0.03) 0.856 (0.02) 0.930 (0.10) 0.738 (0.06) 0.821 (0.07)
SVDD 0.967 (0.01) 0.854 (0.01) 0.907 (0.01) 0.912 (0.07) 0.842 (0.05) 0.875 (0.05) 0.916 (0.06) 0.840 (0.05) 0.875 (0.05)
  1. The bolded value is the best within the group