A Multi-layer Collaborative Cache for Question Answering

  • David Dominguez-Sal
  • Josep Lluis Larriba-Pey
  • Mihai Surdeanu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4641)


This paper is the first analysis of caching architectures for Question Answering (QA). We introduce the novel concept of multi-layer collaborative caches, where: (a) each resource intensive QA component is allocated a distinct segment of the cache, and (b) the overall cache is transparently spread across all nodes of the distributed system. We empirically analyze the proposed architecture using a real-world QA system installed on a cluster of 16 nodes. Our analysis indicates that multi-layer collaborative caches induce an almost two fold reduction in QA execution time compared to a QA system with local cache.


Execution Time Question Answering Local Cache Question Answering System Candidate Answer 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Xin, L., Roth, D.: Learning question classifiers: the role of semantic information. Natural Language Engineering 12(3), 229–249 (2005)Google Scholar
  2. 2.
    Surdeanu, M., Turmo, J., Comelles, E.: Named Entity Recognition from Spontaneous Open-Domain Speech. In: Proceedings of Interspeech (2005)Google Scholar
  3. 3.
    Pasca, M.: Open-Domain Question Answering from Large Text Collections. CSLI Publications Stanford, Calif (2003)Google Scholar
  4. 4.
    Surdeanu, M., Dominguez-Sal, D., Comas, P.: Performance Analysis of a Factoid Question Answering System for Spontaneous Speech Transcriptions. Interspeech  (2006)Google Scholar
  5. 5.
    Barroso, L., Dean, J., Hölzle, U.: Web search for a planet: The google cluster architecture. IEEE Micro 23(2), 22–28 (2003)CrossRefGoogle Scholar
  6. 6.
    Breslau, L., Cao, P., Fan, L., Phillips, G., Shenker, S.: Web caching and zipf-like distributions: Evidence and implications. In: INFOCOM 1999. Proceedings of Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies, pp. 126–134. IEEE, Los Alamitos (1999)Google Scholar
  7. 7.
    Markatos, E.P.: On caching search engine query results. Computer Communications 24(2), 137–143 (2001)CrossRefGoogle Scholar
  8. 8.
    Scime, A., Baeza-Yates, R.: Web Mining: Applications and Techniques. Idea Group (2005)Google Scholar
  9. 9.
    Cardellini, V., Casalicchio, E., Colajanni, M., Yu, P.S.: The state of the art in locally distributed Web-server systems. ACM Computing Surveys 34(2), 263–311 (2002)CrossRefGoogle Scholar
  10. 10.
    Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: Proceedings of the nineteenth ACM symposium on Operating systems principles, pp. 29–43. ACM Press, New York (2003)CrossRefGoogle Scholar
  11. 11.
    Raunak, M.: A survey of cooperative caching. Technical report  (1999)Google Scholar
  12. 12.
    Alonso, R., Barbara, D., Garcia-Molina, H.: Data caching issues in an information retrieval system. ACM Transactions on Database Systems (TODS) 15(3), 359–384 (1990)CrossRefGoogle Scholar
  13. 13.
    Saraiva, P., de Moura, E., Ziviani, N., Meira, W., Fonseca, R., Riberio-Neto, B.: Rank-preserving two-level caching for scalable search engines. In: ACM SIGIR, pp. 51–58 (2001)Google Scholar
  14. 14.
    Zhou, Y., Philbin, J., Li, K.: The multi-queue replacement algorithm for second level buffer caches. In: Proceedings of the General Track: 2002 USENIX Annual Technical Conference, Berkeley, CA, USA, pp. 91–104. USENIX Association (2001)Google Scholar
  15. 15.
    Wong, T., Wilkes, J.: My cache or yours? making storage more exclusive. In: Proceedings of the General Track: 2002 USENIX Annual Technical Conference, Berkeley, CA, USA, pp. 161–175. USENIX Association (2002)Google Scholar
  16. 16.
    Chu-Carroll, J., Czuba, K., Duboue, P., Prager, J.: Ibm’s piquant ii in trec2005. In: Proceedings of the Fourthteen Text REtrieval Conference (TREC) (2005)Google Scholar
  17. 17.
    Robert, E.N.: Javelin i and ii systems at trec 2005. In: Proceedings of the Fourthteen Text REtrieval Conference (TREC) (2005)Google Scholar
  18. 18.
    Moldovan, D., Pasca, M., Harabagiu, S., Surdeanu, M.: Performance issues and error analysis in an open-domain question answering system. ACM Transactions in Information Systems 21(2), 1–22 (2003)Google Scholar
  19. 19.
    Surdeanu, M., Moldovan, D., Harabagiu, S.: Performance analysis of a distributed question/answering system. Transactions on Parallel and Distributed Systems  (2002)Google Scholar
  20. 20.
    Lam, S., Ozu, M.: Querying Web data-the WebQA approach. In: Web Information Systems Engineering. In: WISE 2002, pp. 139–148 (2002)Google Scholar
  21. 21.
    Zheng, Z.: AnswerBus Question Answering System. In: Human Language Technology Conference (HLT 2002), pp. 24–27 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • David Dominguez-Sal
    • 1
  • Josep Lluis Larriba-Pey
    • 1
  • Mihai Surdeanu
    • 2
  1. 1.DAMA-UPC, Universitat Politècnica de Catalunya, Jordi Girona 1,3 08034 BarcelonaSpain
  2. 2.TALP, Universitat Politècnica de Catalunya, Jordi Girona 1,3 08034 BarcelonaSpain

Personalised recommendations