Advertisement

The American Sociologist

, Volume 50, Issue 4, pp 589–607 | Cite as

The Uses of Pilot Studies in Sociology: a Processual Understanding of Preliminary Research

  • C. A. SmithEmail author
Article

Abstract

The following essay examines articles and textbooks that define or operationalize pilot studies in order to detail a set of tools that are situated in the pilot study repertoire. This leads to a distinction between theoretical and methodological purposes, and ultimately suggests that the processes should be used in tandem for the creation of high-quality research. I propose a processual model of preliminary research in which cycles of pilot testing can help to develop theoretically and methodologically sound research. The intent is to consolidate the knowledge from a multitude of sources in order to propose a fleshed out understanding of preliminary work for the benefit of the practitioners and mentors of researchers in sociology.

Keywords

Pilot study Theory Methods Preliminary research 

Notes

Acknowledgements

I would first like to thank Professor Richard Swedberg for his help and mentorship throughout the writing process. Second, I would like to thank Professor Jennifer Platt for her part in the collection of a portion of the textbook literature as well as her insights into future directions of the project. Thank you both for everything you did. This could not have been completed without your help.

References

  1. Abascal, M. (2015). Us and them: Black-White relations in the wake of Hispanic population growth. American Sociological Review, 80(4), 789–813.Google Scholar
  2. Ackoff, R. L. (1953). The design of social research. Chicago: University of Chicago Press.Google Scholar
  3. Aldrich, H., Cater, J., Jones, T., McEvoy, D., & Velleman, P. (1985). Ethnic residential concentration and the protected market hypothesis. Social Forces, 63(4), 996–1009.Google Scholar
  4. Babbie, E. R. (1973). Survey research methods. Belmont: Wadsworth.Google Scholar
  5. Babbie, E. (1986). The practice of social research (4th ed.). Belmont: Wadsworth.Google Scholar
  6. Babbie, E. (1992). The practice of social research (6th ed.). Belmont: Wadsworth.Google Scholar
  7. Babbie, E. (2010). The basics of social research (5th ed.). Belmont: Wadsworth.Google Scholar
  8. Bailey, K. D. (1987). Methods of social research (3rd ed.). New York: The Free Press.Google Scholar
  9. Baker, T. L. (1988). Doing social research. New York: McGraw-Hill.Google Scholar
  10. Bernard, H. R., Wutich, A., & Ryan, G. W. (2017). Analyzing qualitative data: Systematic approaches (2nd ed.). Thousand Oaks: Sage.Google Scholar
  11. Bernburg, J. G., Thorlindsson, T., & Sigfusdottir, I. D. (2009). Relative deprivation and adolescent outcomes in Iceland: a multilevel test. Social Forces, 87(3), 1223–1250.Google Scholar
  12. Besser, T. L. (1993). The commitment of Japanese workers and US workers: a reassessment of the literature. American Sociological Review, 58, 873–881.Google Scholar
  13. Bettelheim, B., & Janowitz, M. (1950). Reactions to fascist propaganda—a pilot study. Public Opinion Quarterly, 14(1), 53–60.Google Scholar
  14. Biggar, J. C., & Martin, J. H. (1976). Ecological determinants of white and black immigration to small areas in central cities, 1965 to 1970. Social Forces, 55(1), 72–84.Google Scholar
  15. Bloom, M. (1986). The experience of research. New York: Macmillan Publishing Company.Google Scholar
  16. Bouma, G. D., Atkinson, G. B. J., & Dixon, B. R. (1995). A handbook of social science research. New York: Oxford University Press.Google Scholar
  17. Bryman, A. (2012). Social research methods (4th ed.). New York: Oxford University Press.Google Scholar
  18. Bryman, A., Bell, E., & Teevan, J.J. (2012). Social research methods. 3rd Canadian ed. North York: Oxford.Google Scholar
  19. Caplow, T. (1956). The dynamics of information interviewing. American Journal of Sociology, 62(2), 165–171.Google Scholar
  20. Chadwick, B. A., Bahr, H. M., & Albrecht, S. L. (1984). Social science research methods. Upper Saddle River: Prentice Hall.Google Scholar
  21. Chambliss, D. F., & Schutt, R. (2016). Making sense of the social world: Methods of investigation (5th ed.). Thousand Oaks: Sage.Google Scholar
  22. Cress, D. M., & Snow, D. A. (1996). Mobilization at the margins: Resources, benefactors, and the viability of homeless social movement organizations. American Sociological Review, 61, 1089–1109.Google Scholar
  23. Cress, D. M., & Snow, D. A. (2000). The outcomes of homeless mobilization: the influence of organization, disruption, political mediation, and framing. American Journal of Sociology, 105(4), 1063–1104.Google Scholar
  24. Cutler, B. R., & Dyer, W. G. (1965). Initial adjustment processes in young married couples. Social Forces, 44(2), 195–201.Google Scholar
  25. Danet, B. (1971). The language of persuasion in bureaucracy:" modern" and" traditional" appeals to the Israel customs authorities. American Sociological Review, 36, 847–859.Google Scholar
  26. Datta, L. (1967). Family religious background and early scientific creativity. American Sociological Review, 32, 626–635.Google Scholar
  27. Dean, L. R. (1961). The pattern variables: some empirical operations. American Sociological Review, 26, 80–90.Google Scholar
  28. DeFleur, M. L., & Crosby, J. (1956). Analyzing metropolitan dominance. Social Forces, 35, 68–75.Google Scholar
  29. Dixon, S., & Quirke, L. (2018). What’s the harm? The coverage of ethics and harm avoidance in research methods textbooks. Teaching Sociology, 46(1), 12–24.Google Scholar
  30. Dobbin, F., & Kelly, E. L. (2007). How to stop harassment: Professional construction of legal compliance in organizations. American Journal of Sociology, 112(4), 1203–1243.Google Scholar
  31. Dobbin, F., Kim, S., & Kalev, A. (2011). You can’t always get what you need: organizational determinants of diversity programs. American Sociological Review, 76(3), 386–411.Google Scholar
  32. Dooley, D. (1984). Social research methods. Upper Saddle River: Prentice Hall.Google Scholar
  33. Dyer, W. G. (1955). The interlocking of work and family social systems among lower occupational families. Social Forces, 34, 230.Google Scholar
  34. Fendrich, J. M., & Axelson, L. J. (1971). Marital status and political alienation among black veterans. American Journal of Sociology, 77(2), 245–261.Google Scholar
  35. Frankfort-Nachmias, C., & Nachmias, D. (2007). Research methods in the social sciences (7th ed.). New York: Worth Publishers.Google Scholar
  36. Friedkin, N. E. (1978). University social structure and social networks among scientists. American Journal of Sociology, 83(6), 1444–1465.Google Scholar
  37. Frye, M., & Trinitapoli, J. (2015). Ideals as anchors for relationship experiences. American Sociological Review, 80(3), 496–525.Google Scholar
  38. Gartrell, C. D. (1985). Relational and distributional models of collective justice sentiments. Social Forces, 64(1), 64–83.Google Scholar
  39. Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., Singer, E., & Tourangeau, R. (2009). Survey methodology (2nd ed.). Hoboken: Wiley.Google Scholar
  40. Guthrie, D. (1997). Between markets and politics: organizational responses to reform in China. American Journal of Sociology, 102(5), 1258–1304.Google Scholar
  41. Harris, A. R. (1975). Imprisonment and the expected value of criminal choice: a specification and test of aspects of the labeling perspective. American Sociological Review, 40, 71–87.Google Scholar
  42. Henshel, A. (1973). Swinging: a study of decision making in marriage. American Journal of Sociology, 78(4), 885–891.Google Scholar
  43. Hessler, R. M. (1992). Social research methods. New York: West Publishing.Google Scholar
  44. Humphrey, R. (1985). How work roles influence perception: structural-cognitive processes and organizational behavior. American Sociological Review, 50, 242–252.Google Scholar
  45. Hyman, R., & Cohen, E. G. (1957). Water-w itching in the United States. American Sociological Review, 22(6), 719–724.Google Scholar
  46. Jesser, C. J., & Donovan, L. P. (1969). Nudity in the art training process: an essay with reference to a pilot study. The Sociological Quarterly, 10(3), 355–371.Google Scholar
  47. Jones, R. A. (1985). Research methods in the social and behavioral sciences. Sunderland: Sinauer Associates.Google Scholar
  48. Judkins, B., & Hand, C. (1994). The changing nature of sociological inquiry: a review of research methods textbooks. Teaching Sociology, 22(1), 105–117.Google Scholar
  49. Jupp, V., & Sapsford, R. (Eds.). (1996). Data collection and analysis. Thousand Oaks: Sage.Google Scholar
  50. Katz, E., Gurevitch, M., Danet, B., & Peled, T. (1969). Petitions and prayers: a method for the content analysis of persuasive appeals. Social Forces, 47(4), 447–463.Google Scholar
  51. Katz, E., Haas, H., & Gurevitch, M. (1973). On the use of the mass media for important things. American Sociological Review, 38, 164–181.Google Scholar
  52. Khawaja, M. (1994). Resource mobilization, hardship, and popular collective action in the West Bank. Social Forces, 73(1), 191–220.Google Scholar
  53. Lazarsfeld, P. F. (1944). The controversy over detailed interviews—an offer for negotiation. Public Opinion Quarterly, 8(1), 38–60.Google Scholar
  54. Lieberson, S., & Mikelson, K. S. (1995). Distinctive African American names: an experimental, historical, and linguistic analysis of innovation. American Sociological Review, 60, 928–946.Google Scholar
  55. Lundberg, G. A. (1946). Social research. New York: Longmans, Green and Co.Google Scholar
  56. Lundsgaarde, H. P. (1963). Differential assimilation and the perpetuation of sub-cultural goals: a pilot study of a Danish-American Village in California. Acta Sociologica, 7(1), 1–18.Google Scholar
  57. Macy, M. W. (1993). Backward-looking social control. American Sociological Review, 58, 819–836.Google Scholar
  58. Marjoribanks, K. (1972). Ethnic and environmental influences on mental abilities. American Journal of Sociology, 78(2), 323–337.Google Scholar
  59. Marwell, G., & Hage, J. (1970). The organization of role-relationships: a systematic description. American Sociological Review, 35, 884–900.Google Scholar
  60. Mazur, A., Mazur, J., & Keating, C. (1984). Military rank attainment of a west point class: effects of cadets' physical features. American Journal of Sociology, 90(1), 125–150.Google Scholar
  61. McIntyre, L. (2005). Need to know: Social science research methods. New York: McGraw-Hill Education.Google Scholar
  62. Miller, J., Slomczynski, K. M., & Kohn, M. L. (1985). Continuity of learning-generalization: the effect of job on men's intellective process in the United States and Poland. American Journal of Sociology, 91(3), 593–615.Google Scholar
  63. Minnis, M. S. (1963). The relationship of the social structure of an Indian community to adult and juvenile delinquency. Social Forces, 41(4), 395–403.Google Scholar
  64. Montagna, P. D. (1968). Professionalization and bureaucratization in large professional organizations. American Journal of Sociology, 74(2), 138–145.Google Scholar
  65. Neuman, W. L. (1994). Social research methods: Qualitative and quantitative approaches (2nd ed.). Boston: Allyn and Bacon.Google Scholar
  66. Neuman, W. L. (2011). Social research methods: Qualitative and quantitative approaches (7th ed.). London: Pearson.Google Scholar
  67. Newman, W. M. (1971). Role conflict in the ministry and the role of the seminary: a pilot study. Sociological Analysis, 32(4), 238–248.Google Scholar
  68. Nowak, S. (1960). Egalitarian attitudes of Warsaw students. American Sociological Review, 25, 219–231.Google Scholar
  69. Pager, D. (2003). The mark of a criminal record. American Journal of Sociology, 108(5), 937–975.Google Scholar
  70. Parten, M. (1950). Surveys polls and samples: Practical procedures. New York: Harper & Brothers.Google Scholar
  71. Pedulla, D. S., & Thébaud, S. (2015). Can we finish the revolution? Gender, work-family ideals, and institutional constraint. American Sociological Review, 80(1), 116–139.Google Scholar
  72. Phillips, B. (1985). Sociological research methods: An introduction. Belmont: Dorsey Press.Google Scholar
  73. Phillips, D. L., & Clancy, K. J. (1970). Response biases in field studies of mental illness. American Sociological Review, 35, 503–515.Google Scholar
  74. Phillips, S., & Cooney, M. (2005). Aiding peace, abetting violence: third parties and the management of conflict. American Sociological Review, 70(2), 334–354.Google Scholar
  75. Phillips, E. M., Odunlami, A. O., & Bonham, V. L. (2007). Mixed race: understanding difference in the genome era. Social Forces, 86(2), 795–820.Google Scholar
  76. Poston, D. L., Jr., & Falbo, T. (1990). Academic performance and personality traits of Chinese children:" Onlies" versus others. American Journal of Sociology, 96(2), 433–451.Google Scholar
  77. Reiss, A. J., Jr. (1959). Rural-urban and status differences in interpersonal contacts. American Journal of Sociology, 65(2), 182–195.Google Scholar
  78. Rose, A. M., & Prell, A. E. (1955). Does the punishment fit the crime? A study in social valuation. American Journal of Sociology, 61(3), 247–259.Google Scholar
  79. Rosenblum, B. (1978). Style as social process. American Sociological Review, 43, 422–438.Google Scholar
  80. Rossi, A. S. (1984). Gender and parenthood. American Sociological Review, 49, 1–19.Google Scholar
  81. Sample, J., & Warland, R. (1973). Attitude and prediction of behavior. Social Forces, 51(3), 292–304.Google Scholar
  82. Schlemmer, L. (1972). City or rural “homeland”: a study of patterns of identification among Africans in South Africa's divided society. Social Forces, 51(2), 154–164.Google Scholar
  83. Schuman, H., & Presser, S. (1979). The open and closed question. American Sociological Review, 44, 692–712.Google Scholar
  84. Schutt, R. K. (1987). Recent research methods texts; means for achieving course goals? Teaching Sociology, 15(2), 203–213.Google Scholar
  85. Schutt, R. K. (2012). Investigating the social world: The process and practice of research (7th ed.). Thousand Oaks: Sage.Google Scholar
  86. Schutt, R. K. (2015). Investigating the social world: The process and practice of research (8th ed.). Thousand Oaks: Sage.Google Scholar
  87. Sedlack, R. G., & Stanley, J. (1992). Social research: Theory and methods. Boston: Allyn and Bacon.Google Scholar
  88. Seider, M. S. (1974). American big business ideology: A content analysis of executive speeches. American Sociological Review, 39, 802–815.Google Scholar
  89. Selltiz, C., Jahoda, M., Deutsch, M., & Cook, S. W. (1959). Research methods in social relations. New York: Holt, Rinehart and Winston.Google Scholar
  90. Sharkey, A. J. (2014). Categories and organizational status: the role of industry status in the response to organizational deviance. American Journal of Sociology, 119(5), 1380–1433.Google Scholar
  91. Simon, J. L., & Burstein, P. (1985). Basic research methods in social science (3rd ed.). New York: Random House.Google Scholar
  92. Singleton, R., & Straits, B. C. (2011). Approaches to social research (5th ed.). New York: Oxford.Google Scholar
  93. Singleton, R., Straits, B. C., & Straits, M. M. (1993). Approaches to social research (2nd ed.). New York: Oxford.Google Scholar
  94. Slomczynski, K. M., Miller, J., & Kohn, M. L. (1981). Stratification, work, and values: a Polish-United States comparison. American Sociological Review, 46, 720–744.Google Scholar
  95. Snow, D. A., Soule, S. A., & Cress, D. M. (2005). Identifying the precipitants of homeless protest across 17 US cities, 1980 to 1990. Social Forces, 83(3), 1183–1210.Google Scholar
  96. Srivastava, S. B., & Banaji, M. R. (2011). Culture, cognition, and collaborative networks in organizations. American Sociological Review, 76(2), 207–233.Google Scholar
  97. Stanton, H. R., & Litwak, E. (1955). Toward the development of a short form test of interpersonal competence. American Sociological Review, 20(6), 668–674.Google Scholar
  98. Sullivan, M. A., Queen, S. A., & Patrick, R. C. (1958). Participant observation as employed in the study of a military training program. American Sociological Review, 23(6), 660–667.Google Scholar
  99. Sutcliffe, J. P., & Haberman, M. (1956). Factors influencing choice in role conflict situations. American Sociological Review, 21(6), 695–703.Google Scholar
  100. Sutton, J. R., Dobbin, F., Meyer, J. W., & Scott, W. R. (1994). The legalization of the workplace. American Journal of Sociology, 99(4), 944–971.Google Scholar
  101. Swedberg, R. (2016). Before theory come theorizing or how to make social science more interesting. British Journal of Sociology, 67(1), 5–22.Google Scholar
  102. Swedberg, R. (2019). On the uses of exploratory research and exploratory studies in social science. In J. Gerring, C. Elman, & J. Mahoney (Eds.), Producing knowledge. Cambridge, UK: Cambridge University Press, forthcoming.Google Scholar
  103. Sweetser, D. A. (1963). Asymmetry in intergenerational family relationships. Social Forces, 41(4), 346–352.Google Scholar
  104. Tucker, G. R., & Lambert, W. E. (1969). White and negro listeners' reactions to various American-English dialects. Social Forces, 47(4), 463–468.Google Scholar
  105. Williamson, R. C. (1962). Some variables of middle and lower class in two Central American cities. Social Forces, 41(2), 195–207.Google Scholar
  106. Young, P. V., & Schmid, C. F. (1944). Scientific social-surveys and research (3rd ed.). Upper Saddle River: Prentice-Hall.Google Scholar
  107. Young, P. V., & Schmid, C. F. (1949). Scientific social-surveys and research. Upper Saddle River: Prentice-Hall.Google Scholar
  108. Zhou, X., & Hou, L. (1999). Children of the cultural revolution: the state and the life course in the People's Republic of China. American Sociological Review, 64, 12–36.Google Scholar
  109. Zurcher, L. A., Jr., Meadow, A., & Zurcher, S. L. (1965). Value orientation, role conflict, and alienation from work: a cross-cultural study. American Sociological Review, 30, 539–548.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Cornell UniversityIthacaUSA

Personalised recommendations