Abstract
Adaptive tutoring is essentially a decision process, in each step of which an optimal tutoring action is chosen and taken. In recent years, researchers have been increasingly interested in applying the partially observable Markov decision process (POMDP) model to build intelligent tutoring systems (ITSs). The POMDP model may enable an ITS to optimize tutoring when uncertainties exist. Computing in a POMDP is characterized by exponential costs, in both time and space, which obstruct the POMDP model for practical applications. In our research, we develop techniques to improve computing efficiency in a POMDP based ITS. In this paper, we report a space-efficient technique of policy trees. The technique may help achieve high space efficiency by grouping policy trees and dynamically creating the policy trees to be evaluated in making a decision.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Carlin, A., Zilberstein, S.: Observation compression in DEC-POMDP policy trees. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multi-agent Systems, pp. 31–45 (2008)
Cassandra, A.: A survey of POMDP applications. In: Working Notes of AAAI 1998 Fall Symposium on Planning with Partially Observable Markov Decision Process, pp. 17–24 (1998)
Chinaei, H.R., Chaib-draa, B., Lamontagne, L.: Learning observation models for dialogue POMDPs. In: Kosseim, L., Inkpen, D. (eds.) AI 2012. LNCS (LNAI), vol. 7310, pp. 280–286. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-30353-1_24
Folsom-Kovarik, J.T., Sukthankar, G., Schatz, S.: Tractable POMDP representations for intelligent tutoring systems. ACM Trans. Intell. Syst. Technol. (TIST) 4(2), 29 (2013). Special section on agent communication, trust in multiagent systems, intelligent tutoring and coaching systems archive
Rafferty, A.N., Brunskill, E., Griffiths, T.L., Shafto, P.: Faster teaching by POMDP planning. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 280–287. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_37
Theocharous, G., Beckwith, R., Butko, N., Philipose, M.: Tractable POMDP planning algorithms for optimal teaching in SPAIS. In: IJCAI PAIR Workshop (2009)
Wang, F.: Handling exponential state space in a POMDP-based intelligent tutoring system. In: Proceedings of 6th International Conference on E-Service and Knowledge Management (IIAI ESKM 2015), pp. 67–72 (2015)
Wang, F.: A new technique of policy trees for building a POMDP based intelligent tutoring system. In: Proceedings of The 8th International Conference on Computer Supported Education (CSEDU 2016), pp. 85–93 (2016)
Wang, F.: Dynamical creation of policy trees for a POMDP-based intelligent tutoring system. In: Proceedings of The 10th International Conference on Computer Supported Education (CSEDU 2018), pp. 137–144 (2018)
Williams, J.D., Poupart, P., Young, S.: Factored partially observable Markov decision processes for dialogue management. In: Proceedings of Knowledge and Reasoning in Practical Dialogue Systems (2005)
Williams, J.D., Young, S.: Partially observable Markov decision processes for spoken dialog systems. Comput. Speech Lang. 21, 393–422 (2007)
Woolf, B.P.: Building Intelligent Interactive Tutors. Morgan Kaufmann Publishers, Burlington (2009)
Acknowledgements
This research is supported by the Natural Sciences and Engineering Research Council of Canada (NSERC).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, F. (2019). A Space-Efficient Technique of Policy Trees for an Intelligent Tutoring System on POMDP. In: McLaren, B., Reilly, R., Zvacek, S., Uhomoibhi, J. (eds) Computer Supported Education. CSEDU 2018. Communications in Computer and Information Science, vol 1022. Springer, Cham. https://doi.org/10.1007/978-3-030-21151-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-21151-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-21150-9
Online ISBN: 978-3-030-21151-6
eBook Packages: Computer ScienceComputer Science (R0)