Abstract
In this paper the issue of labeling noise is considered. Data labeling is the integral stage of the most part of the machine learning projects, so the problem spotlighted in the paper is quite topical.
According to the labeling noise source classification, a new approach is proposed, affecting both of the labeling noise sources. The first component of the approach is based on the distributed ledger technologies principles, including the automatic consensus between the experts. The second component includes the devices dependability improvement by means of fog- and edge-computing usage. Also some models are developed to estimate the approach and selected results of the simulation are presented and discussed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Auto-Keras. https://autokeras.com/. Accessed 19 May 2019
Welcome to AirSim. https://github.com/microsoft/AirSim. Accessed 19 May 2019
Detectron. https://research.fb.com/downloads/detectron/. Accessed 19 May 2019
Machine Learning Project Structure: Stages, Roles, and Tools. https://www.altexsoft.com/blog/datascience/machine-learning-project-structure-stages-roles-and-tools/. Accessed 19 May 2019
Hickey, R.J.: Noise modeling and evaluating learning from examples. Artif. Intell. 82(1–2), 157–179 (1996)
Frénay, B., Verleysen, M.: Classification in the presence of label noise: a survey. IEEE Trans. Neural Netw. Learn. Syst. 25(5), 845–869 (2014)
Manwani, N., Sastry, P.S.: Noise tolerance under risk minimization. IEEE Trans. Cybern. 43(3), 1146–1151 (2013)
McDonald, A., Hand, D.J., Eckley, I.A.: An empirical comparison of three boosting algorithms on real data sets with artificial class noise. In: Proceedings 4th International Workshop Multiple Classifier Systems, Guilford, UK, pp. 35–44, June 2003
Abellán, J., Masegosa, A.R.: Bagging decision trees on datasets with classification noise. In: Link, S., Prade, H. (eds.) Foundations of Information and Knowledge Systems. FoIKS 2010. Lecture Notes in Computer Science, vol. 5956, pp. 248–265. Springer, Heidelberg (2010)
Joseph, L., Gyorkos, T.W., Coupal, L.: Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. Am. J. Epidemiol. 141(3), 263–272 (1995)
Perez, C.J., Giron, F.J., Martin, J., Ruiz, M., Rojano, C.: Misclassified multinomial data: a bayesian approach. Rev. R. Acad. Cien. Serie A. Mat. 101(1), 71–80 (2007)
Brodley, C.E., Friedl, M.A.: Identifying mislabeled training data. J. Artif. Intell. Res. 11, 131–167 (1999)
Gamberger, D., Boskovic, R., Lavrac, N., Groselj, C.: Experiments with noise filtering in a medical domain. In: Proceedings 16th International Conference on Machine Learning, Bled, Slovenia, June 1999, pp. 143–151. Springer, San Francisco (1999)
Krauth, W., Mezard, M.: Learning algorithms with optimal stability in neural networks. J. Phys. A: Gen. Phys. 20(11), L745 (1987)
Clark, P., Niblett, T.: The CN2 induction algorithm. Mach. Learn. 3(4), 261–283 (1989)
Cantador, I., Dorronsoro, J.R.: Boosting parallel perceptrons for label noise reduction in classification problems. In: Proceedings of First International Work-Conference on the Interplay Between Natural and Artificial Computation, IWINAC 2005. Lecture Notes in Computer Science, Las Palmas, Canary Islands, Spain, 15–18 June 2005, vol. 3562, pp. 586–593 (2005)
Kalyaev, I., Melnik, E., Klimenko, A.: A technique of adaptation of the workload distribution problem model for the fog-computing environment. In: Silhavy, R. (ed.) Cybernetics and Automation Control Theory Methods in Intelligent Algorithms. CSOC 2019. Advances in Intelligent Systems and Computing, vol. 986. Springer, Cham (2019)
Melnik, E.V., Klimenko, A.B., Ivanov, D.Y.: The Distributed ledger-based technique of the neuronet training set forming. In: Silhavy, R., Silhavy, P., Prokopova, Z. (eds.) Computational Statistics and Mathematical Modeling Methods in Intelligent Systems. CoMeSySo 2019. Advances in Intelligent Systems and Computing, vol. 1047. Springer, Cham (2019)
Distributed ledger technology: beyond blockchain. https://www.gov.uk/government/news/distributed-ledger-technology-beyond-block-chain. Accessed 20 May 2019
Wüst, K., Ritzdorf, H., Karame, G.O., Glykantzis, V., Capkun, S., Gervais, A.: On the security and performance of proof of work blockchains. In: Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, pp. 3–16. ACM, New York (2016)
An introduction to the Block-Lattice. https://medium.com/coinmonks/an-introduction-to-the-block-lattice-382071fc34ac. Accessed 20 May 2019
Nguyen, G., Kim, K.: A survey about consensus algorithms used in blockchain. J. Inf. Process. Syst. 14(1), 101–128 (2018)
Bonomi, F, Milito, R, Zhu, J., Addepalli, S.: Fog computing and its role in the internet of things. In: Proceedings of the first edition of the MCC Workshop on Mobile Cloud Computing, pp. 13–16. ACM, Mew York (2012)
Moysiadis, V., Sarigiannidis, P., Moscholios, I.: Towards distributed data management in fog computing. Wirel. Commun. Mob. Comput. 2018 (2018). article ID 7597686, 14 p
Chiang, M., Zhang, T.: Fog and IoT: an overview of research opportunities. IEEE Internet Things J. 3(6), 854–864 (2016)
Melnik, E.V., Klimenko, A.B., Ivanov, D.Y.: Fog-computing concept usage as means to enhance information and control system reliability. J. Phys: Conf. Ser. 1015(3), 032175 (2018)
Melnik, E.V., Klimenko, A.B., Ivanov, D.Y.: Distributed information and control system reliability enhancement by fog-computing concept application. In: IOP Conference Series: Materials Science and Engineering, vol. 327, no. 2 (2018)
Melnik, E., Klimenko, A., Ivanov, D.: The model of device community forming problem for the geographically-distributed information and control systems using fog-computing concept. In: IV International research conference Information technologies in Science, Management, Social sphere and Medicine (ITSMSSM 2017), Advances in Computer Science Research, vol. 72, pp. 132–136. Atlantis Press, Amsterdam (2017)
Wilson, R., Martinez, T.R.: Instance pruning techniques. In: Proceedings of the 14th International Conference on Machine Learning, Nashville, TN, July 1997, pp. 403–411 (1997)
Hart, P.: The condensed nearest neighbor rule. IEEE Trans. Inf. Theory 14, 515–516 (1968)
pBFT—Understanding the Consensus Algorithm. https://medium.com/coinmonks/pbft-understanding-the-algorithm-b7a7869650ae. Accessed 19 May 2019
Paxos Made Simple. https://lamport.azurewebsites.net/pubs/paxos-simple.pdf. Accessed 19 May 2019
Strogonov, S.A.: Individual reliability forecasting of IC chip with the help of ARIMA models. Mag. Compon. Technol. 10, 44–49 (2006)
Acknowledgements
The paper has been prepared within the RFBR project 18-29-22086 and RAS presidium fundamental research №7 «New designs in the prospective directions of the energetics, mechanics and robotics», № gr.project AAAA-A18-118020190041-1.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Melnik, E.V., Klimenko, A.B. (2020). A Complex Approach to the Data Labeling Efficiency Improvement. In: Kovalev, S., Tarassov, V., Snasel, V., Sukhanov, A. (eds) Proceedings of the Fourth International Scientific Conference “Intelligent Information Technologies for Industry” (IITI’19). IITI 2019. Advances in Intelligent Systems and Computing, vol 1156. Springer, Cham. https://doi.org/10.1007/978-3-030-50097-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-50097-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50096-2
Online ISBN: 978-3-030-50097-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)