Skip to main content

SciCrowd: Towards a Hybrid, Crowd-Computing System for Supporting Research Groups in Academic Settings

  • Conference paper
  • First Online:
Collaboration and Technology (CRIWG 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11001))

Included in the following conference series:

Abstract

The increasing amount of scholarly literature and the diversity of dissemination channels are challenging several fields and research communities. A continuous interplay between researchers and citizen scientists creates a vast set of possibilities to integrate hybrid, crowd-machine interaction features into crowd science projects for improving knowledge acquisition from large volumes of scientific data. This paper presents SciCrowd, an experimental crowd-powered system under development “from the ground up” to support data-driven research. The system combines automatic data indexing and crowd-based processing of data for detecting topic evolution by fostering a knowledge base of concepts, methods, and results categorized according to the particular needs of each field. We describe the prototype and discuss its main implications as a mixed-initiative approach for leveraging the analysis of academic literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.mturk.com/.

  2. 2.

    https://fold.it/portal/.

  3. 3.

    http://dblp.uni-trier.de/.

  4. 4.

    https://docs.google.com/forms/.

References

  1. Gil, Y., Greaves, M., Hendler, J., Hirsh, H.: Amplify scientific discovery with artificial intelligence. Science 346(6206), 171–172 (2014)

    Article  Google Scholar 

  2. Farooq, U., Ganoe, C.H., Carroll, J.M., Giles, C.L.: Designing for e-science: requirements gathering for collaboration in CiteSeer. Int. J. Hum. Comput. Stud. 67, 297–312 (2009)

    Article  Google Scholar 

  3. Thelwall, M.: Using altmetrics to support research evaluation. In: Proceedings of the International Workshop on Altmetrics for Research Outputs Measurements and Scholarly Information Management, pp. 11–28 (2018)

    Google Scholar 

  4. Correia, A., Fonseca, B., Paredes, H.: Exploiting classical bibliometrics of CSCW: classification, evaluation, limitations, and the odds of semantic analytics. In: Proceedings of the International Conference on Human Factors in Computing and Informatics, pp. 137–156 (2013)

    Google Scholar 

  5. Kitchenham, B., Brereton, O.P., Budgen, D., Turner, M., Bailey, J., Linkman, S.: Systematic literature reviews in software engineering – a systematic literature review. Inf. Softw. Technol. 51(1), 7–15 (2009)

    Article  Google Scholar 

  6. Cooper, S., et al.: The challenge of designing scientific discovery games. In: Proceedings of the ACM International Conference on the Foundations of Digital Games, pp. 40–47 (2010)

    Google Scholar 

  7. Tinati, R., Van Kleek, M., Simperl, E., Luczak-Rösch, M., Simpson, R., Shadbolt, N.: Designing for citizen data analysis: a cross-sectional case study of a multi-domain citizen science platform. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 4069–4078 (2015)

    Google Scholar 

  8. Chau, D.H., Kittur, A., Hong, J.I., Faloutsos, C.: Apolo: making sense of large network data by combining rich user interaction and machine learning. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 167–176 (2011)

    Google Scholar 

  9. Dong, Z., Lu, J., Ling, T.W., Fan, J., Chen, Y.: Using hybrid algorithmic-crowdsourcing methods for academic knowledge acquisition. Clust. Comput. 20(4), 3629–3641 (2017)

    Article  Google Scholar 

  10. Correia, A., Schneider, D., Fonseca, B., Paredes, H.: Crowdsourcing and massively collaborative science: a systematic literature review and mapping study. In: Rodrigues, A., et al. (eds.) CRIWG 2018. LNCS, vol. 11001, pp. 133–154 (2018)

    Google Scholar 

  11. Horvitz, E.: Principles of mixed-initiative user interfaces. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 159–166 (1999)

    Google Scholar 

  12. Bontcheva, K., Roberts, I., Derczynski, L., Rout, D.: The GATE crowdsourcing plugin: crowdsourcing annotated corpora made easy. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp. 97–100 (2014)

    Google Scholar 

  13. Borne, K.: Collaborative annotation for scientific data discovery and reuse. Bull. Am. Soc. Inf. Sci. Technol. 39(4), 44–45 (2013)

    Article  Google Scholar 

  14. Dunne, C., Shneiderman, B., Gove, R., Klavans, J., Dorr, B.: Rapid understanding of scientific paper collections: integrating statistics, text analytics, and visualization. J. Assoc. Inf. Sci. Technol. 63(12), 2351–2369 (2012)

    Article  Google Scholar 

  15. Rohde, M., Stevens, G., Brödner, P., Wulf, V.: Towards a paradigmatic shift in IS: designing for social practice. In: Proceedings of the DESRIST (2009)

    Google Scholar 

  16. Cheng, J., Bernstein, M.S.: Flock: hybrid crowd-machine learning classifiers. In: Proceedings of the ACM CSCW, pp. 600–611 (2015)

    Google Scholar 

  17. Zhao, Y., Zhu, Q.: Evaluation on crowdsourcing research: current status and future direction. Inf. Syst. Front. 16, 1–18 (2012)

    Google Scholar 

  18. Correia, A., Santos, J., Azevedo, D., Paredes, H., Fonseca, B.: Putting “human crowds” in the loop of bibliography evaluation: a collaborative working environment for CSCW publications. Procedia Technol. 9, 573–583 (2013)

    Article  Google Scholar 

  19. Börner, K., Scharnhorst, A.: Visual conceptualizations and models of science. J. Informetr. 3(3), 161–172 (2009)

    Article  Google Scholar 

  20. Burrows, S., Potthast, M., Stein, B.: Paraphrase acquisition via crowdsourcing and machine learning. ACM Trans. Intell. Syst. Technol. 4(3), 43 (2013)

    Article  Google Scholar 

  21. Rzeszotarski, J., Kittur, A.: CrowdScape: interactively visualizing user behavior and output. In: Proceedings of the Annual ACM Symposium on UIST, pp. 55–62 (2012)

    Google Scholar 

  22. Chilton, L.B., Little, G., Edge, D., Weld, D.S., Landay, J.A.: Cascade: crowdsourcing taxonomy creation. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1999–2008 (2013)

    Google Scholar 

  23. Tchoua, R.B., et al.: Towards a hybrid human-computer scientific information extraction pipeline. In: Proceedings of the IEEE 13th International Conference on e-Science, pp. 109–118 (2017)

    Google Scholar 

Download references

Acknowledgements

This work is financed by the ERDF – European Regional Development Fund through the Operational Programme for Competitiveness and Internationalisation - COMPETE 2020 Programme within project «POCI-01-0145-FEDER-006961», and by National Funds through the Portuguese funding agency, FCT - Fundação para a Ciência e a Tecnologia as part of project «UID/EEA/50014/2013».

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to António Correia .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Correia, A., Schneider, D., Paredes, H., Fonseca, B. (2018). SciCrowd: Towards a Hybrid, Crowd-Computing System for Supporting Research Groups in Academic Settings. In: Rodrigues, A., Fonseca, B., Preguiça, N. (eds) Collaboration and Technology. CRIWG 2018. Lecture Notes in Computer Science(), vol 11001. Springer, Cham. https://doi.org/10.1007/978-3-319-99504-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-99504-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-99503-8

  • Online ISBN: 978-3-319-99504-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics