Skip to main content
SpringerLink
Log in

On solving the SPL problem using the concept of probability flux

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The Stochastic Point Location (SPL) problem Oommen is a fundamental learning problem that has recently found a lot of research attention. SPL can be summarized as searching for an unknown point in an interval under faulty feedback. The search is performed via a Learning Mechanism (LM) (algorithm) that interacts with a stochastic Environment which in turn informs it about the direction of the search. Since the Environment is stochastic, the guidance for directions could be faulty. The first solution to the SPL problem, which was pioneered two decades ago by Oommen, relies on discretizing the search interval and performing a controlled random walk on it. The state of the random walk at each step is considered to be the estimation of the point location. The convergence of the latter simplistic estimation strategy is proved for an infinite resolution, i.e., infinite memory. However, this strategy yields rather poor accuracy for low discretization resolutions. In this paper, we present two major contributions to the SPL problem. First, we demonstrate that the estimation of the point location can significantly be improved by resorting to the concept of mutual probability flux between neighboring states along the line. Second, we are able to accurately track the position of the optimal point and simultaneously show a method by which we can estimate the error probability characterizing the Environment. Interestingly, learning this error probability of the Environment takes place in tandem with the unknown location estimation. We present and analyze several experiments discussing the weaknesses and strengths of the different methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. Since the only possible transitions are moving one state to the left or right.

  2. Suppose the Environment is stationary; λ∗(n) = λ∗, p∗(n) = p > 0.5, and q∗(n) = q = 1 − p.

References

  1. Arntzen E, Steingrimsdottir HS (2014) On the use of variations in a delayed matching-to-sample procedure in a patient with neurocognitive disorder. In: Braunstein SM, Swahn MH, Palmier JB (eds) Mental disorder. iConcept Press

  2. Camp CJ, Foss JW, O’Hanlon AM, Stevens AB (1996) Memory interventions for persons with dementia. Appl Cogn Psychol 10(3):193–210

    Article  Google Scholar 

  3. De Santo M, Percannella G, Sansone C, Vento M (2004) A multi-expert approach for shot classification in news videos. In: International conference image analysis and recognition, pp 564–571. Springer

  4. Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33(1):1

    Article  Google Scholar 

  5. Granmo O-C, John Oommen B (2010) Optimal sampling for estimation with constrained resources using a learning automaton-based solution for the nonlinear fractional knapsack problem. Appl Intell 33(1):3–20

    Article  Google Scholar 

  6. Granmo O-C, John Oommen B (2010) Solving stochastic nonlinear resource allocation problems using a hierarchy of twofold resource allocation automata. IEEE Trans Comput 59(4):545–560

    Article  MathSciNet  MATH  Google Scholar 

  7. Guo Y, Ge H, Huang J, Li S (2016) A general strategy for solving the stochastic point location problem by utilizing the correlation of three adjacent nodes. In: IEEE international conference on data science in cyberspace (DSC). IEEE, pp 215–221

  8. Hammer HL, Yazidi A (2018) Parameter estimation in abruptly changing dynamic environments using stochastic learning weak estimator. Appl Intell 48(11):4096–4112

    Article  Google Scholar 

  9. Havelock J, Oommen BJ, Granmo O-C (2018) Novel distance estimation methods using ?stochastic learning on the line? strategies. IEEE Access 6:48438–48454

    Article  Google Scholar 

  10. Hossain MA, Parra J, Atrey PK, El Saddik A (2009) A framework for human-centered provisioning of ambient media services. Multimed Tools Appl 44(3):407–431

    Article  Google Scholar 

  11. Huang D-S, Jiang W (2012) A general cpl-ads methodology for fixing dynamic parameters in dual environments. IEEE Trans Syst Man Cybern B (Cybernetics) 42(5):1489–1500

    Article  Google Scholar 

  12. Jang YM (2000) Estimation and prediction-based connection admission control in broadband satellite systems. ETRI J 22(4):40–50

    Article  Google Scholar 

  13. Jiang W, Huang D-S, Li S (2016) Random walk-based solution to triple level stochastic point location problem. IEEE Trans Cybern 46(6):1438–1451

    Article  Google Scholar 

  14. Kelly FP (2011) Reversibility and stochastic networks. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  15. Kpamegan EE, Flournoy N (2008) Up-and-down designs for selecting the dose with maximum success probability. Seq Anal 27(1):78–96

    Article  MathSciNet  MATH  Google Scholar 

  16. Landauer TK, Bjork RA (1978) Optimum rehearsal patterns and name learning. In: Gruneberg MM, Morris PE, Sykes RN (eds) Practical aspects of memory. Academic Press, London, pp 625–632

  17. Manning CD, Schütze H (1999) Foundations of statistical natural language processing. MIT Press, Cambridge

    MATH  Google Scholar 

  18. Mofrad AA, Yazidi A, Hammer HL (2017) Solving stochastic point location problem in a dynamic environment with weak estimation

  19. Randolph N (2013) Probability, stochastic processes, and queueing theory: the mathematics of computer performance modeling. Springer Science & Business Media, Berlin

    Google Scholar 

  20. Oommen BJ (1997) Stochastic searching on the line and its applications to parameter learning in nonlinear optimization. IEEE Trans Syst Man Cybern B (Cybernetics) 27(4):733–739

    Article  MathSciNet  Google Scholar 

  21. Oommen BJ, Calitoiu D (2008) Modeling and Simulating a disease outbreak by learning a contagion parameter-based model. In: Proceedings of the spring simulation multiconference, pp 547–555. Society for computer simulation international

  22. Oommen BJ, Kim S-W, Samuel MT, Granmo O-C (2008) A solution to the stochastic point location problem in metalevel nonstationary environments. IEEE Trans Syst Man Cybern B (Cybernetics) 38(2):466–476

    Article  Google Scholar 

  23. Oommen BJ, Raghunath G (1998) Automata learning and intelligent tertiary searching for stochastic point location. IEEE Trans Syst Man Cybern B (Cybernetics) 28(6):947–954

    Article  Google Scholar 

  24. Oommen BJ, Raghunath G, Kuipers B (2006) Parameter learning from stochastic teachers and stochastic compulsive liars. IEEE Trans Syst Man Cybern B (Cybernetics) 36(4):820–834

    Article  Google Scholar 

  25. Oommen BJ, Rueda L (2006) Stochastic learning-based weak estimation of multinomial random variables and its applications to pattern recognition in non-stationary environments. Pattern Recogn 39(3):328–341

    Article  MATH  Google Scholar 

  26. Tao T, Tao H, Cai G, Li S (2013) ALidaptive step searching for solving stochastic point location problem. In: International conference on intelligent computing. Springer, pp 192–198

  27. R Core Team (2017) R: A language and environment for statistical computing

  28. Yazidi A, Granmo O-C, Oommen BJ, Goodwin M (2014) A novel strategy for solving the stochastic point location problem using a hierarchical searching scheme. IEEE Trans Cybern 44(11):2202–2220

    Article  Google Scholar 

  29. Yazidi A, Hammer H, Oommen BJ (2018) Higher-fidelity frugal and accurate quantile estimation using a novel incremental discretized paradigm. IEEE Access 6:24362–24374

    Article  Google Scholar 

  30. Yazidi A, Oommen BJ (2017) A novel technique for stochastic root-finding: enhancing the search with adaptive d-ary search. Inf Sci 393:108–129

    Article  Google Scholar 

  31. Yazidi A, Oommen BJ (2017) The theory and applications of the stochastic point location problem. In: 2017 international conference on new trends in computing sciences (ICTCS). IEEE, pp 333–341

  32. Yazidi A, Oommen BJ (2016) Novel discretized weak estimators based on the principles of the stochastic search on the line problem. IEEE Trans Cybern 46(12):2732–2744

    Article  Google Scholar 

  33. Zhang J, Lu S, Zang D, Zhou M (2016) Integrating particle swarm optimization with stochastic point location method in noisy environment. In: 2016 international conference on systems, man, and cybernetics (SMC). IEEE, pp 002067–002072

  34. Zhang J, Wang Y, Wang C, Zhou M (2017) Symmetrical hierarchical stochastic searching on the line in informative and deceptive environments. IEEE Trans Cybern 47(3):626–635

    Article  Google Scholar 

  35. Zhang J, Zhang L, Zhou M (2015) Solving stationary and stochastic point location problem with optimal computing budget allocation. In: 2015 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 145–150

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, OsloMet - Oslo Metropolitan University, Oslo, Norway

    Asieh Abolpour Mofrad, Anis Yazidi & Hugo Lewi Hammer

Authors
  1. Asieh Abolpour Mofrad
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anis Yazidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hugo Lewi Hammer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Asieh Abolpour Mofrad.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abolpour Mofrad, A., Yazidi, A. & Lewi Hammer, H. On solving the SPL problem using the concept of probability flux. Appl Intell 49, 2699–2722 (2019). https://doi.org/10.1007/s10489-018-01399-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-018-01399-9

Keywords

Search

Navigation