Keywords

1 Introduction

Free/libre open source software (FLOSS) is rapidly becoming mainstream in industry today as evidenced by Microsoft’s acquisition of GitHub, IBM’s purchase of Red Hat, and the wide adoption of FLOSS by the majority of enterprise, mid-market, and small businesses [1]. Results of recent surveys indicate that 92% of respondents identified that their company’s applications contain open source libraries [2] and over 50% of respondents belong to an organization that has an open source software program or has plans to establish one [3].

One reason for the increase in adoption of FLOSS is that it is the source of significant innovation for businesses. Many emerging technologies and approaches that are modernizing computing including cloud computing, containerization, and serverless computing originated with FLOSS. Examples include tools such as Docker and Kubernetes, and FLOSS frameworks such as node.js and JUnit. Indeed processes such as continuous integration and DevOps are heavily based on FLOSS concepts.

This increasing use and development of FLOSS creates a clear need for more software professionals who can develop open source software, as well as providing a strong motivation for students to gain an understanding of FLOSS tools and practices as a part of their undergraduate degree programs. Indeed, FLOSS experience can give students an edge in the hiring process [4]. However, many instructors are not fluent in FLOSS. This paper discusses an assessment of a professional development program for instructors intended to bring them up to speed in FLOSS culture and tools.

2 Challenges

FLOSS practices and tools are not included in typical computing undergraduate degree requirements. In the ACM Curriculum Guidelines, the term “open source” is mentioned only twice in the CS2013 Computer Science Curricula [5] and twice in the IT2017 Information Technology Curricula [6]. The SE2014 Software Engineering Curricula [7] identifies the need for student understanding of FLOSS, yet does not require coverage of FLOSS in the guidelines. This lack of emphasis on FLOSS in professional computing curricula creates a barrier to including FLOSS in the classroom.

Instructors who desire to educate students in FLOSS projects face several additional hurdles. First, many instructors are not familiar with FLOSS culture or tools and face steep learning curves for these, as well as for the FLOSS project domain knowledge. Instructors face an additional learning curve related to how to support student participation in FLOSS projects. Assignment creation, assessment, and development of rubrics are all challenges in the environment of an active FLOSS project and must be undertaken within the constraints of student privacy and intellectual property issues.

Instructors need to learn how to support student learning in the non-traditional environment of a FLOSS project including helping students adjust to a less-structured learning environment and one that has significant size and complexity. Instructors also need to help students with the potentially steep learning curves of FLOSS culture and technologies. Student expectations about the role of the faculty member as a “guide by the side” rather than the “sage on the stage” must be set early and frequently reinforced. Instructors may also need to serve as a liaison between their students and the FLOSS community, which may take additional time.

Another challenge faced by instructors is the selection of an appropriate FLOSS project for use in a course [13]. Ideal FLOSS projects are open to student contributions, welcoming, and have clear communication channels, all while also fulfilling course learning objectives. Several efforts are investigating this problem [8,9,10,11].

The FLOSS project environment presents additional challenges. The FLOSS project schedule and instructor’s academic calendar may not align well. The ability of a FLOSS project to quickly make major changes in direction may also impact student participation. In addition, instructors must plan for contributions over the limited timespan of a term, typically 10 or 15 weeks, once or twice a year.

Results of a research effort [12] that surveyed faculty members as to the challenges faced when involving students in FLOSS projects indicated that lack of time to prepare course materials was the largest hurdle to student involvement, with lack of time in the course for FLOSS as a close second. Additional hurdles included lack of an appropriate course, difficulty in installing the FLOSS environment, and lack of comfort with the FLOSS learning materials.

3 Professors’ Open Source Software Experience Workshops

The faculty development program used in the study is the Professors’ Open Source Software Experience (POSSE) workshop. POSSE was originated by Red Hat in 2009, with the goal to help instructors learn about FLOSS so that they can incorporate it into their courses.

In 2013, a team of instructors received National Science Foundation funding to update POSSE contents to include information on pedagogical and curricular considerations, and to provide funding for faculty attendance. In addition, the focus of POSSE was shifted to Humanitarian Free and Open Source Software (HFOSS) projects as there is some evidence that humanitarian projects are more attractive to women and other under-represented groups. A typical POSSE involves 15–25 instructors new to FLOSS and 3–6 workshop facilitators. POSSE workshops are held in three stages. Stage 1 consists of 8 weeks of online learning activities and three IRC meetings are held to answer questions. Stage 2 is a 2.5 day face-to-face meeting held after stage1 where instructors learn more about FLOSS culture and gain further understanding of how to assess HFOSS projects and incorporate them into their classes. Stage 3 of POSSE occurs after stage 2 and involves instructors working collaboratively on either common projects or common courses to support student involvement in HFOSS. POSSE is supported by over 100 learning materials that instructors may use, located on foss2serve.org. Further information on POSSE is contained in [14] and the foss2serve.org website.

4 The Study

POSSE workshops are showing promise for expanding the number of instructors able to support student learning within HFOSS projects and several publications have resulted from POSSE alumni teaching efforts [15,16,17,18]. As of early 2019, over 150 instructors from over 120 different academic institutions have completed the workshop. These instructors served as the population for a study that involved an online survey followed by a semi-structured interview with the goal of determining the impact of supporting student participation in HFOSS projects on instructors. In this paper, we discuss the impact of POSSE on instructors as observed in interview results.

The participants in the study were selected from instructors who had participated in a POSSE workshop at least one year prior to the study start in order to focus on instructors who had had time to incorporate HFOSS into their classroom. Out of 77 eligible participants, the group was reduced to 41 by selecting only one instructor per academic institution and focusing on participants who were less experienced in FLOSS education at the time of POSSE attendance. The group included instructors who had been successful and unsuccessful in supporting student participation in HFOSS.

Twenty-six instructors completed the survey and 24 of these agreed to participate in the study. Participants were relatively gender balanced, consisting of 11 women and 13 men and participants came from both 2 and 4-year institutions located in 16 different U.S. states. Further details on the study design may be found in [12].

The semi-structured interview included questions such as “What was the biggest hurdle that you encountered and how did you overcome it?” and “What have you learned from working with a FLOSS community?” The study resulted in a considerable volume of data, which is still being analyzed. The focus of this paper is on the impact of POSSE workshops on instructors.

4.1 Results

The corpus of the 24 semi-structured instructor interviews was searched for all occurrences of the terms “POSSE”, “workshop*”, “roundup” and “meet*”. The occurrences of these terms within their context were analyzed by two authors who coded the answers and organized them into categories. The coding process was performed independently to avoid bias and a conflict resolution meeting was used to come to agreement on the categories. Five main themes, described below, emerged.

Helpfulness.

Ten of the respondents identified the POSSE workshop has being helpful using phrases such as “learning activities were immensely helpful”, “very valuable”, and “eye-opening”. One participant stated, “POSSE experience forever changed my perception of what it means to be open source…” An additional three respondents indicated that they had gained a better understanding of FLOSS tools. This feedback clearly indicates that instructors feel that they gain useful knowledge and skills from the POSSE workshop and that the workshop is helpful in supporting student participation in HFOSS projects.

Materials.

Nine respondents indicated that they used the POSSE workshop materials in their courses, either directly or with modification. One participant indicated that POSSE was “…quite helpful with learning activities, I got good ideas for activities…” These responses support the observation that POSSE workshops are fulfilling their goal of providing instructors with the skills and materials they need to support student learning within HFOSS projects.

Enhancements.

Another major theme that emerged was possible enhancements to the POSSE workshop. Ten participants identified augmentations to POSSE that they thought would help them support student participation in HFOSS. These included:

  • Longer workshop meeting with additional hands-on experience with projects

  • Tutorials that instructors and students could use to learn tools

  • List of approachable HFOSS projects including current community contacts

  • Repository of exemplars of student participation in HFOSS

  • Curriculum in a box where a project and set of tools are packaged in a VM

  • More advanced workshop that builds on current POSSE.

Community.

One recurrent theme throughout most of the interviews was the value provided by the POSSE community and the need for it to be an ongoing and healthy community. The use of POSSE “Roundups” and sprints where instructors meet face-to-face to share ideas and work on activities was clearly valued. One respondent indicated “… round ups for me are very beneficial… so I can touch base with other people and hear what other people are doing and exchange ideas.” In addition, some respondents indicated that attending a second POSSE workshop was or would be helpful. Clearly POSSE participants value the community established by the workshops and desire to see that community continue and grow. POSSE appears to work well as an introduction to the topic and the community, but there needs to be ongoing support for the community.

Shortcomings.

Another important theme that emerged from the analysis was identification of the shortcomings of the POSSE experience. Several respondents indicated frustration with not being able to get the HFOSS project development environment installed. One respondent who tried to get an HFOSS project installed while attending POSSE stated, “We spend all of our working time trying to set up the system and never got it set up. That was a kind of negative experience on my part.” Another respondent indicated that the activities in stage 1 and stage 2 needed to be more tightly related stating, “We had a series of HWs prior to workshop, then we didn’t even really discuss them at the workshop…” Another respondent indicated that providing each participant with a concrete take-away appropriate for their class would have been helpful.

Overall, the observations about POSSE indicate that participants are gaining knowledge and skills from the workshops. The majority of participants indicated that they found the workshop helpful and that they used workshop materials in their teaching. The need for continuing community was also a resonant thread throughout the interviews. One respondent noted, “most important takeaway for me is the desire for <the> POSSE organism to remain alive and vibrant moving forward”. Feedback on the shortcomings of the workshop focuses on identification of appropriate course materials and the availability of approachable and tractable HFOSS projects. Instructors involved in carrying out POSSE are currently working to address the shortcomings.

4.2 Limitations

The biggest limitation of the study is that the participants in the study self-selected to participate in the POSSE workshop. A second limitation is the independent coding of the responses. Lastly, the number of professors involved is relatively low, which may limit the generalization of the results.

5 Conclusion and Future Work

The work presented in this paper is a part of a larger study into the impact of student participation in HFOSS on instructors. Results of this study will provide insight into how to increase the number of instructors in the FLOSS education community to fulfill the larger goal of increasing the number of students who graduate ready to contribute to FLOSS projects. Overall, results of analyzing instructor comments on the POSSE workshop experience are positive and appear to indicate that instructors are better able to support student participation in the classroom. The POSSE team is working to address the identified shortcomings of difficulty in project installation and identification of appropriate assignments for those instructors first learning to support FLOSS education. Future areas of study include analysis of instructor expectation, analysis of instructor factors that lead to student success, and how FLOSS education impacts instructor self-perception as a teacher.