Skip to main content
SpringerLink
Log in

Data Collection Methods

  • Chapter
  • First Online:
Wage and Hour Law

  • 392 Accesses

Abstract

The underlying foundation for several commonly-used data collection methods for evaluating wage and hour compliance is provided in this chapter. The resolution of nearly all wage and hour disputes covered in this book requires detailed measurement of the work employees perform, the amount of time spent on that work, and the context in which work is performed. In the past 15 years, consultants and experts have been successfully applying job analysis techniques to collect data to address these issues. The data collection methodologies discussed in this chapter fall into two general categories: observational methodologies and self-report methodologies. Observational methods include live “time and motion” observations and video-based observations. Self-report methods include job analysis questionnaires or surveys and structured interviews. Guidance is also provided for choosing an appropriate method. These methods are customized to address the unique legal questions associated with each wage and hour issue.

The original version of this chapter was revised. A correction to this chapter can be found at https://doi.org/10.1007/978-3-319-74612-8_10

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 84.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See Banks and Cohen (2005).

  2. 2.

    Guion and Highhouse (2006) (p. 25).

  3. 3.

    Guion and Highhouse (2006); Babbie (1990).

  4. 4.

    Nunnally and Bernstein (1994).

  5. 5.

    See Gatewood, Feild & Barrick (2007).

  6. 6.

    See, e.g., Sackett, Walmsley, and Laczo (2013); Wilson, Bennett, Gibson, and Alliger (2012); Morgeson and Dierdorff (2011); Brannick, Levine, and Morgeson (2007); Sanchez and Levine (2001); Harvey (1991); Gael (1988).

  7. 7.

    Sackett et al. (2013), p. 61.

  8. 8.

    Morgeson and Campion (1997).

  9. 9.

    Sanchez and Levine (2001).

  10. 10.

    Banks and Aubry (2005); Banks and Cohen (2005); Ko and Kleiner (2005); Honorée, Wyld, and Juban (2005).

  11. 11.

    See Gatewood et al. (2007); Gael (1988).

  12. 12.

    One exception is the applicability of the professional exemption, which is impacted by the educational background required to perform the job. This issue is discussed in Chap. 3.

  13. 13.

    Sackett (1991) provides actual examples of this issue.

  14. 14.

    29 C.F.R. §541.2.

  15. 15.

    See Harvey and Wilson (2000); Morgeson and Campion (2000); Sanchez and Levine (2000).

  16. 16.

    Lievens, Sanchez, Bartram, and Brown (2010); Dierdorff and Morgeson (2007).

  17. 17.

    Guion and Highhouse (2006).

  18. 18.

    The real issue is when the language spoken by the researcher is different from the language spoken by employees. The primary language spoken by researchers may differ by country.

  19. 19.

    Pande and Basak (2015); Guion and Highhouse (2006).

  20. 20.

    Issues related to sampling are covered in Chap. 8.

  21. 21.

    Pigage and Tucker (1954).

  22. 22.

    See, e.g., Kahn and Perkoff (1977).

  23. 23.

    See Roethlisberger and Dickson (1939).

  24. 24.

    Heisenberg (1927).

  25. 25.

    The book was created to help fulfill the mission of the Federal Judicial Center to “develop and conduct educational programs for judicial branch employees.”

  26. 26.

    Diamond (2011).

  27. 27.

    See, e.g., Belli (1998).

  28. 28.

    See, e.g., Schwarz (2007) for a summary.

  29. 29.

    Belli (1998).

  30. 30.

    Belli, Smith, Andreski, and Agrawal (2007); Freedman, Thornton, Camburn, Alwin, and Young-DeMarco (1988); Schwarz (2007); VanDerVaart and Glasner (2007).

  31. 31.

    See Cannell, Oksenberg, Kalton, Bischoping, and Fowler (1989).

  32. 32.

    Krosnick and Presser (2010).

  33. 33.

    Mellow and Sider (1983).

  34. 34.

    Duncan and Hill (1985).

  35. 35.

    Robinson and Bostrom (1994).

  36. 36.

    Babbie (1990).

  37. 37.

    Petersen, Allman and Lee (2015).

  38. 38.

    Diamond (2011).

  39. 39.

    Diamond (2011).

  40. 40.

    Diamond (2011).

  41. 41.

    For example, the court in Walter v Western Hockey League, et al. (2016) found that participants had a legitimate fear of reprisal if their identities were known and allowed self-report data to be collected anonymously and used as evidence.

  42. 42.

    Krosnick and Presser (2010).

  43. 43.

    Krosnick (1991).

  44. 44.

    See, e.g., Marsden and Wright (2010); Babbie (1990).

  45. 45.

    See Krosnick and Presser (2010) for more details about question wording.

  46. 46.

    Gatewood et al. (2007).

  47. 47.

    Diamond (2011).

  48. 48.

    Diamond (2011).

  49. 49.

    Diamond (2011); Krosnick and Presser (2010).

  50. 50.

    Diamond (2011); Krosnick and Prosser (2010); Presser et al. (2004); Krosnick (1999).

  51. 51.

    Some have recommended using larger pilot samples. For example, Diamond (2011) recommends a pilot sample of 25–75. The size of the pilot sample depends on the type of study being conducted. Smaller samples, provided they are diverse, are generally considered sufficient in this context.

  52. 52.

    Some issues related to response rates, and specifically non-response bias, are discussed in Chap. 8.

  53. 53.

    See Cortina (1993) for a discussion on appropriate application of this statistic.

  54. 54.

    Gatewood et al. (2007).

  55. 55.

    Diamond (2011); Krosnick and Prosser (2010).

  56. 56.

    Posthuma, Morgeson, and Campion (2002); Eder and Harris (1999).

  57. 57.

    Gatewood et al. (2007).

  58. 58.

    See, e.g., Schmidt and Hunter (1998); Huffcutt and Arthur (1994).

  59. 59.

    Diamond (2011).

  60. 60.

    Babbie (1990).

  61. 61.

    Diamond (2011).

  62. 62.

    See Chap. 1 for more detail about this process.

  63. 63.

    Wright and Marsden (2010).

  64. 64.

    See Diamond (2011); Babbie (1990).

  65. 65.

    See Krippendorff (2013) for a more complete coverage of the content analysis methodology.

  66. 66.

    Pynes and Bernardin (1992).

References

  • Babbie, E. R. (1990). Survey research methods (2nd ed.). Belmont, CA: Wadsworth.

    Google Scholar 

  • Banks, C. G., & Aubry, L. W. (2005). How to conduct a wage and hour audit for exemptions to overtime laws. Bender’s Labor & Employment Bulletin, 292–302.

    Google Scholar 

  • Banks, C. G., & Cohen, L. (2005). Wage and hour litigation: I-O psychology’s new frontier. In F. J. Landy (Ed.), Employment discrimination litigation. San Francisco: Jossey-Bass/Pfeiffer.

    Google Scholar 

  • Belli, R. F. (1998). The structure of autobiographical memory and the event history calendar: Potential improvements in the quality of retrospective reports in surveys. Memory, 6, 383–406.

    Article  Google Scholar 

  • Belli, R. F., Smith, L. M., Andreski, P. M., & Agrawal, S. (2007). Methodological comparisons between CATI event history calendar and standardized conventional questionnaire instruments. Public Opinion Quarterly, 71, 603–622.

    Article  Google Scholar 

  • Brannick, M. T., Levine, E. L., & Morgeson, F. P. (2007). Job Analysis: Methods, research, and applications for human resource management (2nd ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Campion, M. A., Palmer, D. K., & Campion, J. E. (1997). A review of structure in the selection interview. Personnel Psychology, 50, 655–702.

    Article  Google Scholar 

  • Cannell, C. F., Oksenberg, L., Kalton, G., Bischoping, K., & Fowler, F. J. (1989). New techniques for pretesting survey questions (Research Rep.). Ann Arbor, MI: Survey Research Center, University of Michigan.

    Google Scholar 

  • Cortina, J. M. (1993). What Is coefficient alpha: An examination of theory and applications? Journal of Applied Psychology, 78, 98–104.

    Article  Google Scholar 

  • Diamond, S. S. (2011). Reference guide on survey research. InReference manual of scientific evidence (3rd ed.). Washington, DC: National Academies Press.

    Google Scholar 

  • Dierdorff, E. C., & Morgeson, F. P. (2007). Consensus in work role requirements: The influence of discrete occupational context on role expectations. Journal of Applied Psychology, 92, 1228–1124.

    Article  Google Scholar 

  • Duncan, G., & Hill, D. (1985). An investigation of the extent and consequences of measurement error in labor-economic survey data. Journal of Labor Economics, 3, 508–532.

    Article  Google Scholar 

  • Eder, R. W., & Harris, M. M. (1999). The employment interview handbook. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Freedman, D., Thornton, A., Camburn, D., Alwin, D., & Young-DeMarco, L. (1988). The life history calendar: A technique for collecting retrospective data. Sociological Methodology, 18, 37–68.

    Article  Google Scholar 

  • Gael, S. (1988). The job analysis handbook for business, industry, and government. New York: Willey.

    Google Scholar 

  • Gatewood, R. D., Feild, F. S., & Barrick, M. (2007). Human resource selection (7th ed.). Mason, OH: South-Western.

    Google Scholar 

  • Guion, R. M., & Highhouse, S. (2006). Essentials of personnel assessment and selection. New York: Lawrence Erlbaum Associates.

    Google Scholar 

  • Harvey, R. J. (1991). Job analysis. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 2, pp. 71–63). Palo Alto, CA: Consulting Psychologists Press.

    Google Scholar 

  • Harvey, R. J., & Wilson, M. A. (2000). Yes, Virginia, there is an objective reality in job analysis. Journal of Organizational Behavior, 21, 829–854.

    Article  Google Scholar 

  • Heisenberg, W. (1927). Uber den anschaulichen Inhalt der quantentheoretischen Kinematik und Mechanik. Zeitschrift für Physik, 43, 172–198. English translation in (Wheeler and Zurek, 1983), pp. 62–84.

    Article  Google Scholar 

  • Honorée, A. L., Wyld, D. C., & Juban, R. L. (2005). A step-by-step model for employers to comply with the fairpay overtime initiative under the Fair Labor Standards Act (FLSA). Equal Opportunities International, 24(2), 54–66.

    Article  Google Scholar 

  • Huffcutt, A. I., & Arthur, W. (1994). Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. Journal of Applied Psychology, 79, 184–190.

    Article  Google Scholar 

  • Kahn, W. P., & Perkoff, G. T. (1977). Comparability of two methods of time and motion study used in a clinical setting: Work sampling and continuous observation. Med Care, 15(11), 953–960.

    Article  Google Scholar 

  • Ko, H. Y., & Kleiner, B. H. (2005). Analysing jobs to determine exempt or non-exempt status. Equal Opportunities International, 24(5/6), 93–100.

    Article  Google Scholar 

  • Krippendorff, K. (2013). Content analysis: An introduction to its methodology (3rd ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213–236.

    Article  Google Scholar 

  • Krosnick, J. A. (1999). Survey research. Annual Review of Psychology, 50, 537–567.

    Article  Google Scholar 

  • Krosnick, J. A., & Presser, S. (2010). Questions and questionnaire design. In P. V. Marsden & J. D. Wright (Eds.), Handbook of survey research (2nd ed.). Bingley, UK: Emerald.

    Google Scholar 

  • Lievens, F., Sanchez, J. I., Bartram, D., & Brown, A. (2010). Lack of consensus among competency ratings of the same occupation: Noise or substance? Journal of Applied Psychology, 95, 562–571.

    Article  Google Scholar 

  • Marsden, P. V., & Wright, J. D. (2010). Handbook of survey research (2nd ed.). Bingley, UK: Emerald.

    Google Scholar 

  • Mellow, W., & Sider, H. (1983). Accuracy of response in labor market surveys: Evidence and implications. Journal of Labor Economics, 1(4), 331–344.

    Article  Google Scholar 

  • Morgeson, F. P., & Campion, M. A. (1997). Social and cognitive sources of potential inaccuracy in job anlysis. Journal of Applied Psychology, 82(5), 627–655.

    Google Scholar 

  • Morgeson, F. P., & Campion, M. A. (2000). Accuracy in job analysis: Toward an inference-based model. Journal of Organizational Behavior, 21, 819–827.

    Article  Google Scholar 

  • Morgeson, F. P., & Dierdorff, E. C. (2011). Work analysis: From technique to theory. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology (Vol. II, pp. 3–43). Washington, DC: American Psychological Association.

    Google Scholar 

  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Pande, S., & Basak, S. (2015). Human resource management: Text and cases (2nd ed.). New Delhi, India: Vikas Publishing.

    Google Scholar 

  • Petersen, J. S., Allman, P. H., & Lee, W. C. (2015). Surveys in class action wage and hour cases and the use of anonymous respondents. Journal of Legal Economics, 22(1), 25–38.

    Google Scholar 

  • Pigage, L. C., & Tucker, J. L. (1954). Motion and time study. Institute of Labor and Industrial Relations Bulletin, 24, 9–48.

    Google Scholar 

  • Posthuma, R. A., Morgeson, F. P., & Campion, M. A. (2002). Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psychology, 55, 1–81.

    Article  Google Scholar 

  • Presser, S., Rothgeb, J. M., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., & Singer, E. (Eds.). (2004). Methods for testing and evaluating survey questionnaires. New York: Wiley.

    Google Scholar 

  • Pynes, J. E., & Bernardin, H. J. (1992). Mechanical vs consensus- derived assessment center ratings: A comparison of job performance validities. Public Personnel Management, 21(1), 17–28.

    Article  Google Scholar 

  • Robinson, J., & Bostrom, A. (1994). The overestimated workweek? What time diary measures suggest. Monthly Labor Review, 117(1), 11–23.

    Google Scholar 

  • Roethlisberger, F. J., & Dickson, W. J. (1939). Management and the worker: An account of a research program conducted by the Western Electric Company, Hawthorne Works, Chicago. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Sackett, P. R. (1991). Exploring strategies for clustering military occupations. In A. K. Wigdor & B. F. Green (Eds.), Performance assessment for the workplace (pp. 305–330). Washington, DC: National Academy Press.

    Google Scholar 

  • Sackett, P. R., Walmsley, P. T., & Laczo, R. M. (2013). Job and work analysis. In N. Schmitt & S. Highhouse (Eds.), Comprehensive handbook of psychology, volume 12: Industrial and organizational psychology. New York: Wiley.

    Google Scholar 

  • Sanchez, J. I., & Levine, E. L. (2000). Accuracy or consequential validity: Which is the better standard for job analysis data? Journal of Organizational Behavior, 21, 809–818.

    Article  Google Scholar 

  • Sanchez, J. I., & Levine, E. L. (2001). The analysis of work in the 20th and 21st centuries. In N. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), Handbook of industrial, work & organizational psychology (pp. 71–89). London: SAGE.

    Chapter  Google Scholar 

  • Schmidt, F., & Hunter, J. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262–274.

    Article  Google Scholar 

  • Schwarz, N. (2007). Cognitive aspects of survey methodology. Applied Cognitive Psychology, 21(2), 277–287.

    Article  Google Scholar 

  • VanDerVaart, W., & Glasner, T. (2007). Applying a timeline as a recall aid in a telephone survey: A record check study. Applied Cognitive Psychology, 21, 227–238.

    Article  Google Scholar 

  • Walter v. Western Hockey League, et al. (2016). Court file no. 1401-11912, Court of Queen’s Bench of Alberta (Canada).

    Google Scholar 

  • Wilson, M. A., Bennett, W., Gibson, S. G., & Alliger, G. M. (Eds.). (2012). The handbook of work analysis in organizations: The methods, systems, applications, and science of work measurement in organizations. New York: Routledge.

    Google Scholar 

  • Wright, J. D., & Marsden, P. V. (2010). Survey research and social science: History, current practice, and future prospects. In P. V. Marsden & J. D. Wright (Eds.), Handbook of survey research (2nd ed.). Bingley, UK: Emerald.

    Google Scholar 

Statutes and Regulations

Download references

Author information

Authors and Affiliations

  1. Berkeley Research Group, Emeryville, CA, USA

    Chester Hanvey

Authors
  1. Chester Hanvey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chester Hanvey .

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hanvey, C. (2018). Data Collection Methods. In: Wage and Hour Law. Springer, Cham. https://doi.org/10.1007/978-3-319-74612-8_2

Download citation

Publish with us

Policies and ethics

Search

Navigation