Skip to main content
Log in

Learning about meetings

  • Published:
Data Mining and Knowledge Discovery Aims and scope Submit manuscript

Abstract

Most people participate in meetings almost every day, multiple times a day. The study of meetings is important, but also challenging, as it requires an understanding of social signals and complex interpersonal dynamics. Our aim in this work is to use a data-driven approach to the science of meetings. We provide tentative evidence that: (i) it is possible to automatically detect when during the meeting a key decision is taking place, from analyzing only the local dialogue acts, (ii) there are common patterns in the way social dialogue acts are interspersed throughout a meeting, (iii) at the time key decisions are made, the amount of time left in the meeting can be predicted from the amount of time that has passed, (iv) it is often possible to predict whether a proposal during a meeting will be accepted or rejected based entirely on the language (the set of persuasive words) used by the speaker.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. More details of definition of dialogue acts can be found in (McCowan et al. 2005).

  2. We also varied \(C_1\) and \(C_2\) and the results were consistent. While doing so, we kept \(C_1\) below 5 so that each reduction in the size of the template costs us no more than 5 in edit distance. We kept \(C_2\) below 0.5 to ensure that we would not remove a backwards arrow to sacrifice accuracy.

References

  • Agrawal R, Gunopulos D, Leymann F (1998) Mining process models from workflow logs. Springer, Heidelberg

    Google Scholar 

  • Banerjee S, Rudnicky AI (2004) Using simple speech based features to detect the state of a meeting and the roles of the meeting participants. In: Proceedings of international conference on spoken language processing, pp 221–231

  • Black D (1948) On the rationale of group decision-making. J Polit Econ 56(1):23–34

    Article  Google Scholar 

  • Bousmalis K, Mehu M, Pantic M (2009) Spotting agreement and disagreement: a survey of nonverbal audiovisual cues and tools. In: Proceedings of 3rd international conference on affective computing and intelligent interaction and workshops, pp 1–9

  • Bui TH, Frampton M, Dowding J, Peters S (2009) Extracting decisions from multi-party dialogue using directed graphical models and semantic similarity. In: Proceedings of the 10th special interest group on discourse and dialogue workshop on discourse and dialogue, pp 235–243

  • Carlson G (2012) Uplifting word list: http://www.freelance-copy-writing.com/Uplifting-Word-List.html. Accessed 20 Apr 2012

  • Carnegie D (1936) How to win friends and influence people. Simon & Schuster, New York

    Google Scholar 

  • Davis JH (1973) Group decision and social interaction: a theory of social decision schemes. Psychol Rev 80(2):97–125

    Article  Google Scholar 

  • Eddy SR (1998) Profile hidden markov models. Bioinformatics 14(9):755–763

    Article  Google Scholar 

  • Ertekin S, Rudin C (2011) On equivalence relationships between classification and ranking algorithms. J Mach Learn Res 12:2905–2929

    MATH  MathSciNet  Google Scholar 

  • Eugenio BD, Jordan PW, Thomason JH, Moore JD (1999) The agreement process: an empirical investigation of human-human computer-mediated collaborative dialogues. Int J Hum Comput Stud 53(6):1017–1076

    Article  Google Scholar 

  • Fernández R, Frampton M, Ehlen P, Purver M, Peters S (2008) Modeling and detecting decisions in multi-party dialogue. In: Proceedings of the 9th special interest group on discourse and dialogue workshop on discourse and dialogue, pp 156–163

  • Galley M, McKeown K, Fosler-Lussier E, Jing H (2003) Discourse segmentation of multi-party conversation. In: Proceedings of the 41st annual meeting of association for, computational linguistics, pp 562–569

  • Green SG, Taber TD (1980) The effects of three social decision schemes on decision group process. Organ Behav Hum Perform 25(1):97–106

    Article  Google Scholar 

  • Guerini M, Strapparava C, Stock O (2008) Trusting politicians’ words (for persuasive NLP). In: Computational linguistics and intelligent text processing, pp 263–274

  • Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46(1–3):389–422

    Article  MATH  Google Scholar 

  • Hahn S, Ladner R, Ostendorf M (2006) Agreement/disagreement classification: exploiting unlabeled data using contrast classifiers. In: Proceedings of the human language technology conference of the North American chapter of the association for computational linguistics, pp 53–56

  • Hall J (1994) Americans know how to be productive if managers will let them. Organ Dyn 33:33–46

    Article  Google Scholar 

  • Hillard D, Ostendorf M (2003) Detection of agreement vs. disagreement in meetings: training with unlabeled data. In: Proceedings of the human language technology conference of the North American chapter of the association for computational linguistics

  • Hsueh PY, Moore J (2008) Automatic decision detection in meeting speech. In: Machine Learning for Multimodal Interaction, pp 168–179

  • Ji G, Bilmes J (2005) Dialog act tagging using graphical models. In: Proceedings of international conference on acoustics, speech, and signal processing, vol 1, pp 33–36

  • Kayser TA (1990) Mining group gold: how to cash in on the collaborative brain power of a group. Serif Publishing, El Segundo

    Google Scholar 

  • Lyngsø RB, Pedersen CNS (2002) The consensus string problem and the complexity of comparing hidden Markov models. J Comput Syst Sci 65(3):545–569

    Article  Google Scholar 

  • Mackenzie A, Nickerson P (2009) The time trap: the classic book on time management. Amacom Books, New York

    Google Scholar 

  • McCowan I, Carletta J, Kraaij W, Ashby S, Bourban S, Flynn M, Guillemot M, Hain T, Kadlec J, Karaiskos V et al (2005) The AMI meeting corpus. In: Proceedings of methods and techniques in behavioral research

  • Nagata M, Morimoto T (1994) First steps towards statistical modeling of dialogue to predict the speech act type of the next utterance. Speech Commun 15(3–4):193–203

    Article  Google Scholar 

  • Newlund D (2012) Make your meetings worth everyone’s time. http://www.usatoday.com/USCP/PNI/Business/2012-06-20-PNI0620biz-career-getting-aheadPNIBrd_ST_U.htm. Accessed 1 July 2012

  • Olsen H (2009) Persuasive words. http://www.high-output.com/uncategorized/108-persuasive-words/. Accessed 20 Apr 2012

  • Panko RR, Kinney ST (1995) Meeting profiles: size, duration, and location. In: Proceedings of the twenty-eighth Hawaii international conference on system sciences, vol 4, pp 1002–1011

  • Purver M, Dowding J, Niekrasz J, Ehlen P, Noorbaloochi S, Peters S (2007) Detecting and summarizing action items in multi-party dialogue. In: Proceedings of the 8th special interest group on discourse and dialogue workshop on discourse and dialogue

  • Reiter S, Rigoll G (2005) Multimodal meeting analysis by segmentation and classification of meeting events based on a higher level semantic approach. In: Proceedings of international conference on acoustics, speech, and signal processing, vol 2, pp 161–164

  • Romano NC Jr, Nunamaker JF Jr (2001) Meeting analysis: findings from research and practice. In: Proceedings of the 34th annual Hawaii international conference on system sciences

  • Ron D, Singer Y, Tishby N (1996) The power of amnesia: learning probabilistic automata with variable memory length. Mach Learn 25(2–3):117–149

    Article  MATH  Google Scholar 

  • Scheidel TM (1967) Persuasive speaking. Scott, Foresman and Company, Glenview

    Google Scholar 

  • Sim JS, Park K (2003) The consensus string problem for a metric is NP-complete. J Discrete Algorithms 1(1):111–117

    Article  MATH  MathSciNet  Google Scholar 

  • SRI International (2003–2009) CALO: cognitive assistant that learns and organizes. http://caloproject.sri.com. Accessed 10 Aug 2012

  • Sternthal B, Phillips LW, Dholakia R (1978) The persuasive effect of scarce credibility: a situational analysis. Public Opin Q 42(3):285–314

    Article  Google Scholar 

  • Stolcke A, Ries K, Coccaro N, Shriberg E, Bates R, Jurafsky D, Taylor P, Martin R, Ess-Dykema CV, Meteer M (2000) Dialogue act modeling for automatic tagging and recognition of conversational speech. Comput Linguist 26(3):339–373

    Article  Google Scholar 

  • Tur G, Stolcke A, Voss L, Peters S, Hakkani-Tur D, Dowding J, Favre B, Fernandez R, Frampton M, Frandsen M, Frederickson C, Graciarena M, Kintzing D, Leveque K, Mason S, Niekrasz J, Purver M, Riedhammer K, Shriberg E, Tien J, Vergyri D, Yang F (2010) The CALO meeting assistant system. IEEE Trans Audio Speech and Lang Process 18(6):1601–1611

    Article  Google Scholar 

  • van der Aalst WMP (1998) The application of petri nets to workflow management. J Circuits Syst Comput 8(01):21–66

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Been Kim.

Additional information

Responsible editor: Guest Editors of the Special issue PKDD 2013 (Dr.Toon Calders, Prof. Floriana Esposito, Prof. Eyke Hüllermeier and Dr. Rosa Meo).

Appendix: Proof of Theorem 1

Appendix: Proof of Theorem 1

We will use Hoeffding’s inequality combined with the union bound to create a uniform generalization bound over all viable templates. The main step in doing this is to count the number of possible viable templates. Let us do this now.

Let \(\Lambda \) be the set of possible dialogue acts, and denote \(|\Lambda |\) as the number of elements in the set. We will calculate the number of templates that are of size less than or equal to \(L\), which is the size of our function class in statistical learning theory.

For a template of exactly length \(n\), there are \(|\Lambda |^n\) possible assignments of dialogue acts for the templates. Also, for a template of length \(n\), there are at most \({n(n-1)/2 \atopwithdelims ()B}\) possible assignments of \(B\) backward arrows, where \(B \le n\). To see this, consider the set of backwards arrows as represented by an \(n\times n\) adjacency matrix, where only the part below the diagonal could be 1. There are \(n^2\) total elements in the matrix, \(n\) on the diagonal, so \(n(n-1)\) off diagonal elements, and \(n(n-1)/2\) elements in the lower triangle. If exactly \(b\) of these can be 1, the total number of possibilities is at most \({n(n-1)/2 \atopwithdelims ()b}\). There can be up to \(B\) backward arrows, so the total number of possibilities is at most

$$\begin{aligned} \sum _{b=0}^{\min (B,n)} {n(n-1)/2 \atopwithdelims ()b}. \end{aligned}$$

Note that this number is an upper bound, as usually we cannot have more than one backwards arrow leaving or entering a node. Finally we could have \(n\) anywhere between 0 and \(L\) so the final number of possible templates has upper bound:

$$\begin{aligned} \sum _{n=0}^{L} |\Lambda |^n \sum _{b=0}^{\min (B,n)} {n(n-1)/2 \atopwithdelims ()b}. \end{aligned}$$

Hoeffding’s inequality applies to arbitrary bounded loss functions. This, combined with a union bound over all viable templates, yields the statement of the theorem.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, B., Rudin, C. Learning about meetings. Data Min Knowl Disc 28, 1134–1157 (2014). https://doi.org/10.1007/s10618-014-0348-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10618-014-0348-z

Keywords

Navigation