Technology enhancing mathematics learning behaviours: Shifting learning goals from “producing the right answer” to “understanding how to address current and future mathematical challenges”
 356 Downloads
Abstract
This paper reports how an information and communications technology (ICT) system can support greater connection across and outcomes from home and school mathematics learning practices for 11to14yearold pupils. The article details: (1) the purpose, background and theoretical basis of the study; (2) the design approach, including features, accessibility and implementation of a web platform (eZbirka) created as a tool for solving teacherreported problems in learning practices; (3) the methodological approach adopted for the study; and (4) the effects and contributions of webbased homeandschoollinked practice on pupils and teachers. Interviews with and surveys from pupils and teachers were used to gather data. Findings highlighted the efficacy of the system, indicating benefits arising when pupils and teachers used the entire range of features. This communication and collaboration tool enabled teachers to assist pupils in developing knowledge and abilities only a short time after its inception. Research revealed specific features of the software that support ICT integration into mathematics teaching and learning practices; specifically, it shifts an ineffective learning process and offers new ways of thinking about mathematical learning.
Keywords
Mathematics teaching Mathematics learning Homework Learning behaviours Pupil learning needs Educational software1 Purpose and rationale
This paper considers the challenge and outcomes of creating software to support mathematical thinking behaviours through learning activities in school, to connect across different environments, and provide teachers with necessary information about pupils’ thinking and their knowledge levels. The features of the software created, pedagogic innovations and purposes of the educational software that were developed, mathematics learning arising, and analysis of the attitudes and outcomes of pupils and teachers who used the created web platform, are presented here.
An overview of the context of teachers and pupils in which the system was developed (in Serbia) will initially be presented, together with a discussion and consideration of key factors concerned with the importance of homework, its role in educational systems and the ways it fits into teaching practices. Following the statement of the research questions, problems and barriers that can affect processes of implementation of educational software in teaching are discussed in the literature review, which also highlights key issues that need to be addressed to ensure appropriate use of information and communications technology (ICT) materials in educational processes. Following an overview of the theoretical framework, the design approach to the development of the technologicallybased platform called eZbirka, created at the Faculty of Mathematics at the University of Belgrade, is detailed. The aim of the software was to support teachers in: (1) addressing negative behaviours – the copying of homework solutions between pupils; and (2) enabling teachers to be aware of the problems and barriers pupils face when confronted with the need for understanding of mathematical concepts. The research methods for the study are detailed, followed by a presentation of results obtained, analyses of research findings, and discussion of outcomes arising.
As an introduction to the rationale for this study, according to early findings by Hart and Walker (1993) and Wong (2001), the way educational software impacts on the attitudes of pupils and teachers depends on the subject topic for which the software is used, on characteristics of classroom instruction, types of assessment, and material delivery tools. This paper will show how these (and other) factors were considered in the software design approach that was taken. In recent years, education, and especially mathematics education, has had access through research to an increasingly diverse number of different class teaching instructional approaches (National Centre for Excellence in the Teaching of Mathematics 2012; Pelgrum and Law 2009). However, as stated in these sources, the variety of learning instruction often depends on ICT resource availability and support materials for different teaching practices.
In Serbia, there is no organised production of digital materials specifically adapted to the national curriculum or to school activities. Teachers in schools often use data projectors to show Microsoft (MS) PowerPoint presentations, which they have previously created at home (The Institute for the Advancement of Education 2014a). Additionally, they sometimes use blogs to exchange materials with pupils. However, all these activities are based on the individual efforts of teachers (Džigurski et al. 2013).
“Homework assignments are an important component of the teaching process. They not only test how much the pupils have mastered certain materials, but they present an introduction of independent work and selfeducation to pupils. Tasks should be varied, and by difficulty should be balanced, in accordance with the knowledge and skills of all pupils.” (The Institute for the Advancement of Education 2014b, p. 83)
In addition to regular classes, which are compulsory for all pupils, regulations specify the need for extra lessons and mathematics classes (for pupils who achieve aboveaverage results) and additional classes (for pupils who score belowaverage results). Achievements of pupils at school and the work they complete at home help teachers to identify any issues or problems which require more time in additional classes, as well as how to continue the planning of regular curricular activities. The results of homework tasks help teachers to detect problems at the earliest stage that they appear, and help them to address these as soon as possible. Andrić (2011), in a study about homework tasks, makes a comment on their value in the educational system in Serbia, saying:
“Homework assignments are probably the most frequent form of checking pupils’ knowledge and skills in mathematics. They are mainly given to pupils after each teaching period i.e. class, regardless of whether it is time to acquire new knowledge or time for practicing. Homework has an aim to broaden pupils’ individual work and make them rehearse extra in courses and at home.” (Andrić 2011, p. 17)
Reports from teachers in Serbia, however, present another view of homework practices; pupils copy solutions of homework tasks before the class, so they do not do the tasks by themselves at home. This behaviour is reported by teachers to be becoming more common, and large numbers of pupils are finding an easier way to solve homework tasks by simply using copypaste and write actions. As a result, teachers do not have access to the real level of knowledge of their pupils after each teaching unit. Moreover, teachers do not have a valid instrument that allows them to perceive the problems that pupils experience when completing tasks and hence are not able to plan appropriate ways to address barriers in the knowledge of their pupils. As a consequence, pupils do not understand all the material; they disengage from completing tasks, they do not learn regularly, and they become used to copying. Thus, one very important part of the teaching process becomes meaningless and useless. It is not surprising that pupils continue having difficulties with managing their homework. In such a dysfunctional practice, problems continue to accrue, with less and less chance for solving them.
Indeed, reports from teachers indicate that they become aware of the real problems of limited pupil knowledge and the obstacles they face only after completing regular tests and examinations (one per month). At this later time, teachers report that it is too late to address issues and misunderstandings. In such a system, as stated by Killoran (2003), ensuring pupils complete their homework has become one of the most frequent and frustrating behavioural problems for educators. This was the key purpose for the development of the educational software eZbirka.
2 Research questions

Did the educational software that was developed address the problem identified (enable pupils and teachers to monitor mathematical thinking and behaviours more effectively), according to teachers and pupils?

If so, how did it do this, and to what extent?

How effective did teachers and pupils rate the system, and why?
3 Literature review
Interactive teaching materials have been found from earlier studies to have the potential of making a significant contribution to the teaching and learning of mathematics (Balacheff and Kaput 1996; Sutherland 2007). For example, Ruthven et al. (2004) in their research stated that when pupils were working on computers and learning with the help of a systematic medium, they were more able to focus on patterns and connections between multiple representations. It was reported in another study that computer use might enable a deeper, more direct mathematical experience (Balacheff and Kaput 1996). Other researchers have pointed out major ways in which ICT can provide better environments for the learning of mathematics. For example: providing fast and reliable feedback (Becta 2009); creating environments with real examples when exploring mathematical problems (Noss and Hoyles 1996); seeing connections between representations and changes in mathematical objects (Condie and Munro 2007); working with dynamic images; and enabling work with real data to be represented in a variety of ways (Godwin and Sutherland 2004).
From a pedagogic perspective, Sinclair and Jackiw (2005), in their study about the features and characteristics of what they called a new wave of ICT technologies in the classroom, identified important pedagogic features that need to be considered when using them. They identified relationships among individual learners; grouping of learners; the role of the teacher; the layout of the classroom; alternative classroom practices; and relationships to the world outside the classroom (Sinclair and Jackiw 2005; Walker et al. 2012). However, although there can be a positive impact of ICT on mathematics teaching, the integration of digital resources into teaching practice is not necessarily straightforward; it seems from a range of studies to be more difficult than expected. Indeed, many studies have shown obstacles that teachers experience when integrating ICT in their classrooms (Beaudin 2002; Jones 2004; Rogers 2000; Snoeyink and Ertmer 2002; Takači et al. 2017). Barriers can be grouped into: lack of confidence among teachers; lack of quality software; poor curriculum connections; lack of time for integration; lack of effective training; technical problems while the software is in use; lack of vision as to how to integrate ICT in instruction; lack of personal access during lesson preparation; and negative teacher attitudes towards computers (Fethi and Inan 2010; Hew and Hara 2007). These factors clearly need to be considered in a design approach for new educational software.
In terms of the influence of design approaches on teacher use, Miller et al. (2008) in their report highlight the problem of appropriate technology choices for education. They state that the key issue for success of educational technology is appropriate choice of software, which will support learning and teaching. An earlier report by Ofsted (the inspection system for schools in England) “ICT in Schools” (2002), indicated that: “Less successful use of ICT in subject teaching core typically stems from weak links between the computer task and the lesson objectives. Too many teachers select software packages for their visual appeal rather than their relevance to lessons.” It is essential, therefore, that the design of educational software should be adaptable to the curriculum for which it is intended. Research studies suggest that beliefs about adaptation, like perceived usefulness of ICT solutions, has a direct influence on systemic use and technology adoption (Venkatesh and Davis 2000). A later study stated that functionality, features and the visual identity of a software solution must be adaptable to pupils’ ages (Farmer and Tilton 2006), and use in learning should be simple, flexible and purposefully focused for pupils and by teachers.
It has been argued that methods and effective ways of implementation through which information technology can improve educational curricular activities have in part been identified but are still yet to be fully found (Romero et al. 2007; Topper and Lancaster 2013). For implementation to improve educational activities, research studies show that it is necessary to plan and develop elements of technology enhanced education that accord with school community, society, present teaching methods and environmental features in which the educational software will be implemented (Hijon and Carlos 2006; Nistor et al. 2013; Passey 2000; Takači et al. 2017). Additionally, studies highlight the fact that implementation should be customised to support specific pupil needs and address observed problems in teaching (Passey 2013; Tapscott 2009). In terms of pupil needs, Clark et al. (2014) investigated factors influencing teachers’ beliefs about their pupils’ mathematical understandings and attitudes, and concluded that teachers could better meet pupils’ needs when they understood pupils’ prior mathematical knowledge, experience and attitudes. Campbell et al. (2014) also highlighted that teachers claimed both awareness of their pupils’ attitudes towards mathematics and their organising of instruction as being important factors to support further progress and proficiency of mathematics skills. In terms of pedagogical interactions, Goos (2010) stated that:
“Opportunities arise at three levels that represent the teacher’s thinking about: the tasks they will set their students (using technology to improve speed, accuracy, access to a variety of mathematical representations); classroom interactions (using technology to improve the display of mathematical solution processes and support students’ collaborative work); the subject (using technology to support new goals or teaching methods for a mathematics course).” (Goos 2010, p. 68)
Recently, questions about how ICT might support education reform in mathematics has focused on exploring educational technology as a tool for development of pupils’ reasoning through problem solving and discourse (Kitchen and Berk 2016). These authors stress that mathematics is best learned when pupils and teachers have the opportunity to engage in brainstorming through which mathematical ideas are generated, shared, and gaps in mathematical understanding are investigated and debated. They highlight the need for research on computer software programs that help pupils to apply mathematics concepts and skills. Foster et al. (2016), for example, evaluated effects of a mathematics software program, ‘Building Blocks’, on young children’s mathematics performance. They concluded that when information technologies are used with educational purpose and to meet pedagogical goals, when there is a clearly defined method of implementation, with a strong continued and planned focus, then positive results are likely to arise. Their findings are commensurate with results from research into computerassisted instruction (CAI) and from metaanalyses suggesting that mathematics learning of kindergartenaged children can be enhanced by using researchbased software interventions. While the need to use software to focus on the pedagogical context as a whole can bring benefits, the authors stated in conclusion also that, “it remains possible that other supplemental mathematics programs, tutoring, and even mathematics homework could be equally beneficial” (Foster et al. 2016, p. 21).
Relating the concerns and features identified in the review above to homework activities (in mathematics or other subject education), as Cooper (2001) stated, homework is a “battlefield”. Yet homework practice is an issue of everyday importance for teachers, pupils, and parents. Although previous research about homework practice has indicated that forms and qualities of homework can make a difference to pupil knowledge, the connection between work at home and pupil success in school is far from clear. One research study has shown that benefit arising from homework depends on the attitudes of pupils, but also depends on the items, models, frequencies and the form of tasks assigned (Cooper 2007). Homework may also have nonacademic benefits; for example, it could affect the selfesteem of pupils, development of work skills, responsibility and selfcontrol (Hong and Milgram 2000). Nevertheless, it has been found that too much homework may diminish its effectiveness and have negative impacts on pupils. Furthermore, Kohn (2006) and Moorman and Haller (2006) stated that homework does not provide any academic benefits for pupils who do not possess the skills needed to complete the assignments set.
Early surveys, reviews of research on homework, and recent studies, all indicate common reasons for assigning homework. These include: repeating material that has already been learned in class (Brewster and Fager 2000; Cooper 2007); understanding if pupils have mastered the required skills (National Education Association 2008); introducing pupils to new material that will be presented in the next classes (Pytel 2007); and applying previous knowledge to new situations (Cooper et al. 2006). The amount of time that teachers spend on reviewing homework in mathematics lessons in middle and high schools in the United States of America (USA) has been found to be considerable; 15–20% according to two studies (Grouws et al. 2010; Otten et al. 2015). In terms of guidance for teachers on homework practice, Sinay and Nahornick (2016) stated in response that: “Overall, the focus of homework should be to improve conceptual understanding, fluency, and flexibility in math” (p. 20). Clearly, any design approach should aim to fulfil these aims and objectives.
Research on how homework is related to prior or subsequent teaching emphasises some key influences concerned with specific processes of teaching and learning. For example, the importance of homework is visible when teachers detect problems that pupils have during learning (Epstein and Van Voorhis 2001). Therefore, reviewing homework followed by knowledge and task correction at the beginning of a mathematics lesson may improve pupil achievement. This objective may be achieved in several ways: classes may begin with relatively long sessions of checking homework (as observed in mathematics classes in the United Kingdom and Germany); or begin with a quick review of a previous lesson (observed in mathematics classes in Japan). In all cases, however, some form of analysis of homework outcomes is present in almost all educational systems worldwide (Stigler and Hiebert 1999).
Based on a careful review of tasks, such educational activity may contribute to deciding how to adapt teaching materials in a lesson in order to overcome existing problems. Teachers in practice do not only use tasks and an analysis of pupils’ solutions in order to detect and locate faults, but also to understand and explore why they occurred, how to deal with them, and how to provide assistance to pupils in the following classes, so that they can address those problems.
In addition to the previously stated educational objectives and purposes of homework, it is very important to mention that goals and objectives are also conditioned by social and cultural contexts of the education environment within which teaching takes place. The Shanghai Nineyear Compulsory Education Curriculum Standards document (Shanghai Municipal Education Commission 1998) states, for example, that there are defining obligations related to homework; teachers should ensure that they carefully mark homework and provide feedback to pupils in a timely manner. This expectation can clearly be increased and further reinforced by schoollevel management, who can state that teachers are responsible for the collection and checking of pupils’ workbooks as part of their annual appraisal. Educational software design, therefore, should consider and potentially usefully accommodate such social and cultural concerns.
Parental concerns also influence practice in schools. In the eyes of some parents, a teacher of mathematics who fails to collect and mark pupil homework every day may not be a ‘good teacher’ and schools where this teacher works may then have a poor reputation. However, considering this need at an individual pupil level rather than a class level, as Deubel (2007) says:
“Realistically, differentiation of any kind is difficult to sustain when math class sizes tend to be large and when there are so many demands on teachers for preparing students for standardized testing. Implementing differentiated homework means getting to know your students better than you might now, and having them and parents understand a different view of “fairness”, particularly for grading purposes.” (p. n.p.)
Nevertheless, homework practice can be shaped by social expectations and the pursuit of ‘correct answers and scoring well’ in examinations, including being shaped in this way in the learning cultures of some countries (Biggs 1996). Such ‘correct answer and scoring well’ practices serve as an index, showing what is left to be learned, which is then subsequently used by teachers in their classes (Stevenson and Stigler 1992).
Previous research studies have shown positive results arising when pupils and teachers use webbased homework systems, and that their potential is not only to support the present curriculum but also to enhance the experience and understanding of subject topics (Bonham et al. n.d.; Loveless 1995). A range of studies have shown how certain software has been successfully integrated into different teaching practices to support homework activities. For example, the ASSISTment system, developed at the United States Department of Education and the National Science Foundation, gives teachers the ability to use detailed feedback and to tailor their instruction in order to focus on pupils’ needs (Razzaq et al. 2005). Similarly, Mastering Physics, a webbased physics homework tutor developed at the Massachusetts Institute of Technology, uses mastery learning to help pupils reach mastery levels when solving physics homework problems, as pupils can ask for hints on problems and receive feedback on common errors (Pritchard and Warnakulasooriya 2005). Additionally, pupils who use the Andes system, an intelligent tutoring system that provides support for problem solving for physics homework, can complete whole derivations, stepbystep, and receive feedback after each step (VanLehn et al. 2005). Leatham et al. (2015) state from their research that the success of mathematics teaching depends on the teacher’s ability to use all possible insights about pupil thinking to adjust teaching to that thinking in order to fully develop mathematical concepts. Their conceptualisation of ‘Mathematically Significant Pedagogical Opportunities to Build on Student Thinking’ seeks to improve effectiveness by closely examining classroom discourse. Knowing about the previous knowledge of pupils is considered vitally important if new understanding of mathematical concepts and ways of thinking are to be built. However, the influence of new and existing knowledge is also found to be related in an iterative ‘back and forth’ way, rather than following a single direction, from new to existing knowledge alone (Hohensee 2016).
Advantages of homeworkassistance systems have been identified in the research (Brewster and Fager 2000; Nguyen and Kulm 2005; VanLehn et al. 2005), arising from the provision of immediate feedback to pupils, and automatic grading and recording of grades for instructors. Although these webbased homeworkassistance systems can provide benefits, they can have disadvantages as well. Many of these systems do not consider pupils’ completed or ongoing work, as they require pupils only to enter a single answer for each problem; the system is providing feedback that responds to an incorrect answer rather than giving feedback about the issue that the pupil has. Consequently, teachers are likely to be less able to work out exactly where pupils are having difficulties and barriers to their knowledge, without seeing their work. However, such systems may have a role in motivating pupils to take homework more seriously, because they know it will be graded and the grade will be recorded.
4 Theoretical and conceptual frameworks
The theoretical framework for the educational software design approach of eZbirka and the subsequent study of outcomes from use by teachers and pupils is based on a number of key findings from previous studies. In terms of a theoretical framework for the educational software design, opportunities afforded by educational technologies in the context of connecting learning between home and school were considered fundamentally. Research studies exploring efficacy have highlighted the support provided from the creation of ‘seamless learning spaces’ that will allow instruction (in Goos’s terms, appropriate tasks and interactions) and support (appropriate subject use to match goals or teaching methods) between the home and the school (Chan et al. 2006). Researchers have agreed that technology itself cannot provide a solid connection between the environments in which teaching and learning is carried out, but the manner of such implementation and the role of all involved in the educational process are of great importance (Cagiltay 2007).
In terms of efficacy studies, numerous studies have been reviewed which have sought to understand approaches, scenarios and methods needed for educational technology to connect learning across different settings (Lai et al. 2013). One system, called ASSISTments, aimed at:
“(a) encouraging students to rework problems they initially got wrong (and to enter revised answers), (b) focusing attention on the homework problems that students did not answer correctly, (c) reviewing correct solution processes for the problems that students found difficult, and (d) discussing common wrong answers to address underlying misunderstandings.” (Roschelle et al. 2016, p. 3)

Learning involving uses of technology can be shifted and organised into several and different phases.

Technology can allow a focus on essential learning concerns: practice; revision; identification of successes and issues; reflection; and refocusing.

Teaching can start from an informal setting and allow the teacher to build links and learning through formal and nonformal environments.

The involvement of more informal settings and nonformal support to enhance formal activities can be provided through computersupported learning scenarios.

In conclusion, the authors stated that: “If this is the case, then this platform medium is taking an important step in moving concerns of pupils from ‘the need to produce right answers’ to ‘the use of their issues to support their learning’” (Radović and Passey 2016).
5 Educational software research design
The aims of the platform eZbirka in terms of teaching process were threefold. They were to: (1) help teachers to understand the problems that pupils had, related to the content and understanding of mathematical concepts, relationships and abstract connections; (2) strengthen the relationship between teachers and pupils and to broaden the connection between learning at school and at home; and (3) prevent copying of homework between peers by generating a unique homework set for each pupil. The design of the platform was intended to fit the needs of pupils and teachers by refining, replicating, evaluating, and scaling. Its functionality was created to enable and enhance motivation of pupils to work independently and work better in achieving the goals of quality teaching (as defined by teachers themselves).
At the Faculty of Mathematics in the University of Belgrade, the Faculty of Natural Sciences in the University of Novi Sad, the Faculty of Education in Sombor, and in a number of other regional centres for teacher development throughout Serbia, workshops and educational seminars were held for teachers. Their aim was to educate and train them in appropriate use of the platform in their teaching.
Each prepared set consists of six different homework tasks. Homework sets are designed to cover the material that pupils are taught in particular teaching lessons and to examine all levels of competence that can be gained. Organisation of the tasks into groups, and their combinations, allow homework assignments to be selected by the system, which can be different for each pupil, but having similar problem formulations. The tasks in a group examine the same competencies of a pupil’s knowledge. In this way, the dynamics and variability of tasks in the homework set is ensured.
Pupils can access the platform through all types of modern digital devices, using a web browser. Addressing prominent factors that may represent barriers for the integration of ICT into lessons (Fethi and Inan 2010), access for pupils and teachers is facilitated to the maximum, without losing the structure of the work that the platform provides.
Pupils type a number in the field on the home page for learners, which refers to the homework their teacher gave them in the previous class. Based on this number, the platform generates a homework set. When solving each task, the pupil needs to describe the way the problem is being solved, and to highlight parts of the problemsolving task where there are doubts. In cases when pupils do not know how to solve the problem, the pupil needs to focus on providing an explanation  to define as much as possible what it is that the pupil does not know and what constitutes the problem to solving the task. Therefore, a pupil is always asked to think about the problem and the steps in solving it, and not just how to provide the final answer. After filling in forms for answers, pupils’ work is sent to the teacher, and pupils are able to check their answers instantly. Feedback to pupils is adapted, according to the nature of the task, and the pupil can compare answers with correct answers.
The teacher can review every homework solution and can analyse the responses, comparing pupils’ answers and solutions to the task. There is no automatic grading of pupils’ work. Teachers can have sight of the entirety of pupils’ solutions and ways of thinking, not just access to the final results and statistics. In this way, the teacher can easily perceive problems that pupils encounter and can carefully plan what will be done in any regular, additional or supplementary teaching class.
6 Research methods
In terms of identifying efficacy of a homeworkassistance system, a study by Roschelle et al. (2016) identified the impact on the mathematical abilities of pupils 12 to 13 years of age using a comparative statistical pre and posttest experimental and control design. They found that:
“Results showed that the intervention significantly increased student scores on an endoftheyear standardized mathematics assessment as compared with a control group that continued with existing homework practices. Students with low prior mathematics achievement benefited most. The intervention has potential for wider adoption.” (Roschelle et al. 2016, p. 1)
To explore behavioural outcomes in the context of the study reported in this paper, mixed methods were used, gathering evidence from pupils and teachers following implementation of the software eZbirka in primary schools using questionnaires. These identified whether the system tackled the existing problems in teaching interactions, shifting learning from ‘producing the right answer’ to ‘describing issues to support future learning’. The 620 teachers (all but about 15 from Serbia) registered to use the system has grown steadily over the past years. The research, conducted when the user base was smaller, used an evaluative approach, identifying the effects and contributions of webbased home and school link practices. Two questionnaires were developed in order to collect data from pupils and teachers.
Pupil questionnaire and their answers
Strongly Agree  Agree  Neutral  Disagree  Strongly Disagree  

Q 1 I am doing well with the computer.  131 (66%)  54 (27%)  13 (7%)  0 (0%)  0 (0%) 
Q 2 I use a computer to learn mathematics.  46 (23%)  55 (28%)  73 (37%)  12 (6%)  12 (6%) 
Q 3 Homework on eZbirka is more interesting than regular homework.  127 (64%)  54 (27%)  10 (5%)  4 (2%)  3 (2%) 
Q 4 Tasks on eZbirka are clear and easy to read.  89 (45%)  70 (35%)  32 (16%)  4 (2%)  3 (2%) 
Q 5 It is easy to write answers in the boxes for the solution.  119 (60%)  58 (29%)  17 (9%)  3 (2%)  1 (1%) 
Q 6 I like to receive immediate feedback on my homework task.  153 (77%)  39 (20%)  4 (2%)  1 (1%)  1 (1%) 
Q 7 Immediate feedback after sending the homework to the teacher helps me to recognise my mistakes instantly.  154 (78%)  34 (17%)  7 (4%)  2 (1%)  1 (1%) 
Q 8 Doing homework on eZbirka and immediate feedback help me to be aware of my performance.  126 (64%)  65 (33%)  4 (2%)  0 (0%)  3 (2%) 
Q 9 When I notice that I did a poor homework, I do another and send it to the teacher.  66 (33%)  71 (36%)  35 (18%)  17 (9%)  9 (5%) 
Q 10 Homework on eZbirka gives me more chance to practice.  128 (65%)  56 (28%)  9 (5%)  3 (2%)  2 (1%) 
Q 11 I enjoyed practising homework on eZbirka more than on paperandpencil.  115 (58%)  42 (21%)  35 (18%)  2 (1%)  4 (2%) 
Q 12 When I use eZbirka, my comments help the teacher to review my mathematics concepts.  96 (48%)  78 (39%)  18 (9%)  4 (2%)  2 (1%) 
Q 13 When I use eZbirka, the teacher can better evaluate my understanding, misconception and performance.  127 (64%)  50 (25%)  17 (9%)  3 (2%)  1 (1%) 
Q 14 Homework tasks on eZbirka cannot be copied.  114 (58%)  39 (20%)  24 (12%)  7 (4%)  14 (7%) 
Q 15 I like that we all get different tasks.  96 (48%)  56 (28%)  18 (9%)  14 (7%)  14 (7%) 
Q 16 I think that eZbirka is very useful for pupils.  127 (64%)  59 (30%)  8 (4%)  3 (2%)  1 (1%) 
The questionnaire for teachers consisted of three parts. The first section focused on teachers’ attitudes towards uses of technology in teaching. Teachers were asked to rate their knowledge and skills when using ICT in educational processes. The second section related to teachers’ views towards the use of the platform eZbirka and its usefulness. The third section consisted of groups of questions that assessed and measured factors that need to be fulfilled for appropriate uses of ICT in teaching, mostly adapted from Islam’s (2013) prior research, with minor changes in wording, appropriately targeted for eZbirka use, to identify challenges of the Serbian curriculum and educational policies. A reliability test was carried out to determine internal consistency of items in the questionnaire using Cronbach’s Alpha reliability test.
The pupil questionnaire element of the study gathered evidence from four different primary schools in Serbia. On the platform eZbirka, a public call for mathematics teachers who used the platform eZbirka and wished to participate in a study with their classes was published. Four teachers agreed to join the study with their schools and classes. Teachers were trained on how to follow the requirements of the research reporting process, in the context of their daily usage of eZbirka. In these four primary schools, there were 198 pupils from eight mathematics classes participating (with the numbers of classes participating varying across the schools). There were 94 fifth, 66 sixth, 21 seventh and 17 eighth grade pupils (from 11 to 14 years of age); 92 were female and 106 were male. Pupils completed their homework on the platform eZbirka over a period of two months.
In the second part of the research, on teachers’ attitudes, 80 teachers took part. Using the same public call, teachers were asked to complete a questionnaire, regardless of whether they wished to participate in the study with their classes or not. Responses were collected from schools across Serbia, from teachers using the eZbirka platform in their teaching practices. They anonymously filled out a questionnaire available via the same web address as the platform eZbirka.
The study was conducted over a period of two months. After the test period, pupils were asked to complete the questionnaire regarding their perceptions and evaluations of the webbased practice. The teachers completed an online survey after a similar period of time using eZbirka.
7 Results and implications
Results of the research showed that pupils did not have any major problems in using the platform. Some minor problems that arose concerned the more complicated input of mathematical symbols, an issue that was corrected during the process of developing the working platform. In the study, no significant statistical differences were found between attitudes of boys and girls. Pupils’ responses to the questionnaire are shown in Table 1.
Pupil questionnaire analysis of responses
Q1  Q2  Q3  Q4  Q5  Q6  Q7  Q8  Q9  Q10  Q11  Q12  Q13  Q14  Q15  Q16  

M  4.60  3.56  4.51  4.20  4.47  4.73  4.71  4.57  3.85  4.54  4.32  4.32  4.51  4.17  4.04  4.56 
SD  .612  1.096  .811  .890  .758  .576  .633  .685  1.116  .744  .938  .804  .759  1.205  1.225  .694 
6 ^{ th} grade pupil: “Finally, we use a computer to learn mathematics.”
8 ^{ th} grade pupil: “eZbirka is a good way to use the computer. Using it, we feel as we have additional lessons.”
7 ^{ th} grade pupil: “eZbirka helped us to improve marks. You [pupil speaks to the teacher] should earlier to tell us for this, we would have probably better grades from the beginning of the school year.”
6 ^{ th} grade pupil: “I really like working on eZbirka. It is easier to learn; we can do more tasks and immediately see whether we are doing well. With the help of computers we can do better than to practice in the classroom.”
5 ^{ th} grade pupil: “eZbirka helped me to understand math better and be more active  I feel free to ask questions now.”
8th grade pupil: “I have already got used to this kind of work.”
Prior to use of the eZbirka system, most of the teachers created digital materials by themselves or reshaped alreadyexisting ones, shared them with colleagues, and used materials that were available on the Internet (due to the shortage of adequate highquality electronic interactive teaching materials). Most respondents stated that the great difficulty in applying ICT was the lack of sufficient interactive material, especially when it came to the subject of mathematics (n = 60; 75%). The results of the second part of the questionnaire indicated that they felt that eZbirka was addressing this deficiency. Respondents believed that the use of the eZbirka platform encouraged pupils, built relationships between pupils and teachers, and helped a pupil be more engaged (n = 77; 96.3%).“I apply my competence by making digital materials (PowerPoint presentations and Geogebra applets) that I need for classes. I maintain my own blog, as a tool of communication, primarily with my pupils, but also as a ‘warehouse’ of materials needed for classes.”
“I try to find and use a variety of interactive features for teaching, which enrich the educational process. Not only in terms of production for a given presentation on the theme, but also to connect via social networking site and to set the problems and tasks. As a math teacher, I try to introduce math to pupils as an interesting subject using all available content that can be applied in the classroom.”
“Preparation of Power Point presentation for teaching, the use of pictorial, audiovisual materials which can be found on the network, using the existing program for creating quizzes, crosswords and associations.”
Teachers pointed out that the important functionalities of the homework facilities were to ensure the variability of tests and automatic feedback to facilitate the process of problem solving. As well, teachers believed that pupils were motivated to work (n = 76; 95.0%) because they were sure that they could not then copy the homework and that their work could be evaluated by the teacher. The questionnaire results indicated that teachers were of the opinion that eZbirka helped them to reveal gaps in knowledge of pupils and to successfully plan the next curricular activities (n = 78; 97.5%). Teachers emphasised that the need for pupils to comment helped pupils to think about their knowledge, and to formulate ways to explain how they solved the task. Therefore, they felt pupils were open and willing to express their opinion in regular classes, and they felt more secure about their knowledge. Teachers said that pupils’ comments on tasks provided them with important indicators in identifying gaps in the pupils’ knowledge at an early stage of learning. According to the observations of teachers after a short period of usage, within eight weeks, pupils could build a more positive attitude towards work and teaching activities.
The results of the third part of the teacher questionnaire
M  SD  A  

Rate the measures to be taken in order to engage, improve and enhance the use of ICT in teaching.  .755  
Provide better equipment  4.44  .793  
Provide technical support in school  4.50  .694  
Reward the use of ICT in teaching  4.28  .981  
Provide a more interactive teaching materials  4.60  .668  
Intensively promote online resources and materials  4.48  .711  
Increase support of the School Administration  4.29  .889  
Rate the motives for the use of ICT in teaching.  .897  
Increasing quality of teaching  4.63  .624  
Encouraging pupils’ motivation  4.61  .646  
Improving concentration and attention in class  4.44  .777  
Time rationalisation  4.49  .795  
Better achievement of learning objectives  4.50  .763  
Increased pupil involvement  4.58  .708 
The results of this study indicated that these teachers, in terms of the most important motives for the use of ICT in teaching, were concerned with: raising the quality of teaching and encouraging motivation of pupils; and supporting greater engagement of pupils. Furthermore, the results revealed that respondents were willing to use different and modern learning environments in nontraditional ways, to integrate new technology with their pedagogy, into their curriculum and for learners. The teachers were aware that the aim of reaching these goals required twentyfirstcentury competences to be developed, and they were willing to continue to develop these through personal education and professional training.
Another important fact that testifies to teachers’ attitudes is that, after using the platform eZbirka, all of these teachers continued to use eZbirka beyond the test period. Moreover, teachers encouraged other mathematics teachers from their schools and districts to include use of the platform eZbirka in their daily teaching activities.
8 Contribution to the field of mathematics education
The research questions initially asked: whether the educational software developed addressed the problem identified, according to teachers and pupils; if so, how it did this, and to what extent; and how effective teachers and pupils rated the system, and why. It is clear from the results shown above that the educational software did address the problem of pupils not completing homework tasks on their own, and not enabling teachers to understand their needs with tackling future mathematical tasks.
The Serbian National Plan for Educational Use of Information and Communications Technology (National Education Council 2013) lays out strategic policies and proposals in order to promote meaningful and collaborative learning and to develop learningtolearn and other competencies required in the twentyfirst century. The challenge has been to design and implement a system that successfully bridges the opportunities between home and school, regarding development of understanding and effectiveness of learning, making improvements on former behaviours that have demonstrated particular disadvantages. Much previous research has shown limited success of homework systems in helping formal education, suggesting that a technology used needs to be part of a broader infrastructure of information and support (Cooper 2007; Kerawalla and Crook 2002; Lewin et al. 2003). The Roschelle et al. (2016) study demonstrated the attainment benefits of such a system, while this study has demonstrated the pedagogical, social and learning behaviour benefits that have arisen. The developers of the eZbirka system have created a system that fits into and integrates with the structure of teaching, respecting didactic principles and relying on regulations and laws required by the relevant ministries.
This research has examined: (1) the attitudes and outcomes of pupils using computer technology connections between home and school learning activities; and (2) school teachers’ usage and outcomes of the computer technology system eZbirka. The study showed that teachers did not use the task analysis and task solutions just for detecting and locating faults, but to understand and explore the reasons for their pupils’ problems; they learned how to deal with pupils’ problems, to provide assistance to pupils in subsequent classes so that they could address misunderstandings. eZbirka was valued as a tool that solved the behaviour of cheating and homework copying.
The results of this study indicate that pupils are managing well in working with computers, but do not yet use them fully for learning purposes. However, the study revealed that the innovative practice of assigning homework and work through the platform eZbirka is not difficult for pupils to manage – moreover, pupils say it makes learning more interesting. Pupils positively reported on all aspects of the platform: displaying correct answers; the possibility of resubmitting it to the teacher; commenting on the tasks; and offering questions for the teacher. Pupils can now practice more than they did before. The positive attitudes and the willingness of pupils to be engaged in elearning homework activities suggest that future elearning initiatives designed carefully through an understanding of the conceptual and theoretical bases of needs, have great potential. Furthermore, teachers reported significant positive attitudes toward the use of information technology. The findings indicated that teachers were aware of their limited knowledge regarding the use of computers in teaching. However, teachers were of the opinion that eZbirka as a form of information technology could provide a significantly important level of adaptation to the teaching process.
The need for provision of appropriate training to make ICTsupported learning more widely accepted in educational processes, involving the development of ICT expertise and content for practical use in teaching, needs more exploration. This study examined factors that can influence teachers’ levels of ICT usage. Teachers reported highly and positively on all factors necessary to increase and ensure the use of computers in teaching: providing better equipment; providing technical support to the school; providing more interactive teaching materials; intensively promoting online resources and materials; and increasing support of the school administration. Some technological issues were identified, however, and these clearly needed to be resolved.
It is certain that any change in the educational environment must be undertaken carefully, to promote effective teaching and learning processes, both at individual and at global levels. ICT in education is not about the specific kind of technology available to teachers or learners, it is about having the effective kind of equipment that can improve teaching methods and increase confidence in knowledge development. As the National Council of Teachers of Mathematics (NCTM 2017) have stated: “Effective teachers optimize the potential of technology to develop students’ understanding, stimulate their interest, and increase their proficiency in mathematics”. The findings of this study reveal that the goals and purposes of the educational software eZbirka were achieved in this way, and that its adaptation within education can add to purposeful teaching. These are important conclusions, and its application to other contexts where similar problems exist may well enable pupils and teachers (and parents) to benefit.
Notes
References
 Andrić, V. (2011). Proveravanje i ocenjivanje u nastavi matematike u osnovnoj školi, Državni republički seminar [Examination and evaluation in mathematics teaching in primary school]. Beograd, Serbia: Društvo matematičara Srbije. Retrieved from https://dms.rs/wpcontent/uploads/2016/12/Tema17Andric.pdf.
 Balacheff, N., & Kaput, J. J. (1996). Computerbased learning environments in mathematics. In A. J. Bishop (Ed.), International handbook of mathematics education. Dordrecht: Kluwer.Google Scholar
 Beaudin, L.C. (2002). Bernard Lonergan’s notions of authenticity and technology integration. Unpublished doctoral dissertation, University of Calgary, Calgary, AB, Canada.Google Scholar
 Becta. (2009). Primary mathematics with ICT: A pupil’s entitlement to ICT in primary mathematics. Coventry: Becta.Google Scholar
 Biggs, J. B. (1996). Western misperceptions of the Confucianheritage learning culture. In D. A. Watkins & J. B. Biggs (Eds.), The Chinese learner: Cultural, psychological and contextual influences (pp. 45–67). Hong Kong and Melbourne, VI: CERC and ACERL.Google Scholar
 Bonham, S., Deardorff, D., & Beichner, R. (n.d.). A comparison of pupil performance using web and paperbased homework in collegelevel physics. North Carolina State University, Raleigh, NC. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.604.6601&rep=rep1&type=pdf.
 Brewster, C., & Fager, J. (2000). Increasing Pupil Engagement and Motivation: From TimeonTask to Homework. Retrieved from http://www.nwrel.org/requests/oct00/textonly.html.
 Cagiltay, N. E. (2007). Teaching software engineering by means of computergame development: Challenges and opportunities. British Journal of Educational Technology, 38(3), 405–415.Google Scholar
 Campbell, P., Nishio, M., Smith, T., Clark, L., Conant, D., Rust, A., & Choi, Y. (2014). The relationship between teachers’ mathematical content and pedagogical knowledge, teachers’ perceptions, and student achievement. Journal for Research in Mathematics Education, 45(4), 419–459.Google Scholar
 Chan, T. W., Roschelle, J., Hsi, S., Sharples, M., Brown, T., & Patton, C. (2006). Onetoone technologyenhanced learning: An opportunity for global research collaboration. Research and Practice in Technology Enhanced Learning, 1(01), 3–29.Google Scholar
 Clark, L., DePiper, J., Frank, T., Nishio, M., Campbell, P., Smith, T., & Choi, Y. (2014). Teacher characteristics associated with mathematics Teachers' beliefs and awareness of their students’ mathematical dispositions. Journal for Research in Mathematics Education, 45(2), 246–284.Google Scholar
 Condie, R., & Munro, R. (2007). The impact of ICT in schools: A landscape review. Coventry: Becta.Google Scholar
 Cooper, H. (2001). The battle over homework (2nd ed.). Thousand Oaks: Corwin Press.Google Scholar
 Cooper, H. (2007). The battle over homework: Common ground for administrators, teachers, and parents. Thousand Oaks: Corwin Press.Google Scholar
 Cooper, H., Robinson, J. C., & Patall, E. A. (2006). Does homework improve academic achievement? A synthesis of research, 19872003. Review of Educational Research, 76(1), 1–62.Google Scholar
 Cronbach, L. J., & Shavelson, R. (2004). My [Cronbach] current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391–418.MathSciNetGoogle Scholar
 Deubel, P. (2007). Homework: A math dilemma and what to do about it. THE Journal. Accessible at: https://thejournal.com/articles/2007/10/22/homeworkamathdilemmaandwhattodoaboutit.aspx.
 Džigurski, S., Simić, S., Marković, S., & Šćepanović, D. (2013). Research on the use of information and communication technologies in schools in Serbia. Beograd, Serbia: Social Inclusion and Poverty Reduction Unit, Office of the Deputy Prime Minister for European Integration of Serbia.Google Scholar
 Epstein, J. L., & Van Voorhis, F. L. (2001). More than minutes: Teachers’ roles in designing homework. Educational Psychologist, 36(3), 181–193.Google Scholar
 Farmer J., & Tilton, J. (2006), The use of virtual learning environment software in UK Universities 2001–2005. Industrial Media and Magic Inc Technical Briefs.Google Scholar
 Fethi, A., & Inan, D. L. L. (2010). Factors affecting technology integration in K12 classrooms: A path model. Education Technology Research and Development, 58(1), 137–154.Google Scholar
 Foster, M., Anthony, J., Clements, D., Sarama, J., & Williams, J. (2016). Improving mathematics learning of kindergarten students through computerassisted instruction. Journal for Research in Mathematics Education, 47(3), 206–232.Google Scholar
 Godwin, S., & Sutherland, R. (2004). Whole class technology for learning mathematics: The case of functions and graphs. Education, Communication & Information, 4(1), 131–152.Google Scholar
 Goos, M. (2010). Using technology to support effective mathematics teaching and learning: What counts? Accessed at: http://research.acer.edu.au/cgi/viewcontent.cgi?article=1067&context=research_conference.
 Grouws, D.A., Tarr, J.E., Sears, R., & Ross, D.J. (2010). Mathematics teachers’ use of instructional time and relationships to textbook content organization and class period format. Paper Presented at the Hawaii International Conference on Education, Honolulu, HI.Google Scholar
 Hart, L. E., & Walker, J. (1993). The role of affect in teaching and learning mathematics: Research ideas for the classroom. Reston: National Council of Teachers of Mathematics.Google Scholar
 Hew, K. F., & Hara, N. (2007). Empirical study of motivators and barriers of teacher online knowledge sharing. Educational Technology Research and Development, 55(6), 573–595.Google Scholar
 Hijon, R., & Carlos, R. (2006). Elearning platforms analysis and development of pupils tracking functionality. In E. Pearson & P. Bohman (Eds.). Proceedings of the 18th World Conference on Educational Multimedia Hypermedia & Telecommunications (pp. 2823–2828).Google Scholar
 Hohensee, C. (2016). Teachers’ awareness of the relationship between prior knowledge and new learning. Journal for Research in Mathematics Education, 47(1), 17–27.Google Scholar
 Hong, E., & Milgram, R. M. (2000). Homework: Motivation and learning preference. Westport: Bergin Garvey.Google Scholar
 Islam, A. K. M. N. (2013). Investigating elearning system usage outcomes in the university context. Computers & Education, 69, 387–399.Google Scholar
 Jones, A. (2004). A review of the research literature on barriers to the uptake of ICT by teachers. Coventry: Becta.Google Scholar
 Kerawalla, L., & Crook, C. (2002). Children's computer use at home and at school: Context and continuity. British Educational Research Journal, 28, 751–771.Google Scholar
 Killoran, I. (2003). Why is your homework not done? How theories of development affect your approach in the classroom. Journal of Instructional Psychology, 30(4), 309–315.Google Scholar
 Kitchen, R., & Berk, S. (2016). Educational technology: An equity challenge to the common Core. Journal for Research in Mathematics Education, 47(1), 3–16.Google Scholar
 Knezek, G., Christensen, R., Miyashita, K., & Ropp, M. (2002). Instruments for assessing educator progress in technology integration. Denton, TX: Institute for the Integration of Technology in Teaching and Learning, University of North Texas.Google Scholar
 Kohn, A. (2006). The homework myth: Why our kids get too much of a bad thing. Cambridge: DaCapo Press.Google Scholar
 Lai, K. W., Khaddage, F., & Knezek, G. (2013). Blending student technology experiences in formal and informal learning. Journal of Computer Assisted Learning, 29(5), 414–425.Google Scholar
 Leatham, K., Peterson, B., Stockero, S., & Van Zoest, L. (2015). Conceptualizing mathematically significant pedagogical opportunities to build on student thinking. Journal for Research in Mathematics Education, 46(1), 88–124.Google Scholar
 Lewin, C., Mavers, D., & Somekh, B. (2003). Broadening access to the curriculum though using technology to link home and school: A critical analysis of reforms intended to improve students’ educational attainment. The Curriculum Journal, 14(1), 23–53.Google Scholar
 Loveless, A. (1995). The role of IT: Practical issues for primary teachers. London: Continuum.Google Scholar
 Miller, D. J., Glover, D., & Averis, D. (2008). Enabling enhanced mathematics teaching: Final report for the National Centre for excellence in the teaching of mathematics. London: NCETM.Google Scholar
 Moorman, C., & Haller, T. (2006). Synthesis of Research Findings on Homework. Retrieved from https://janebluestein.com/2012/synthesisofresearchfindingsonhomework/
 National Centre for Excellence in the Teaching of Mathematics. (2012). Mathematics matter: Final report. London: NCETM.Google Scholar
 National Council of Teachers of Mathematics. (2017). Strategic use of technology in teaching and learning mathematics. Retrieved from http://www.nctm.org/StandardsandPositions/PositionStatements/StrategicUseofTechnologyinTeachingandLearningMathematics/.
 National Education Association. (2008). Teaching Research Spotlight: Homework. Retrieved from http://www.nea.org/tools/16938.htm.
 National Education Council. (2013). Guidelines for the promotion of the role of information – Communication technologies in education. Beograd, Serbia. Retrieved from https://www.cipcentar.org/i_roditelji_se_pitaju/PDF/strategija/Smernice%20IKT.pdf.
 Nguyen, D. M., & Kulm, G. (2005). Using webbased practice to enhance mathematics learning and achievement. Journal of Interactive Online Learning (JIOL), 3(3), 1541–4914.Google Scholar
 Nistor, N., Göğüş, A., & Lerche, T. (2013). Educational technology acceptance across national and professional cultures: A European study. Educational Technology Research and Development, 61(4), 733–749.Google Scholar
 Noss, R., & Hoyles, C. (1996). Windows on mathematical meanings: Learning cultures and computers. Dordrecht: Kluwer.Google Scholar
 Ofsted. (2002). Ofsted report: ICT in Schools – Effect of government initiatives. Retrieved from http://www.edtechhistory.org.uk/documents/publications/p_2002_Ofsted_ICT_in_schools_2002.pdf.
 Otten, S., Cirillo, M., & HerbelEisenmann, B. (2015). Making the most of going over homework. Mathematics Teaching in the Middle School, 21(2), 98–105.Google Scholar
 Passey, D. (2000). Developing teaching strategies for distance (outofschool) learning in primary and secondary schools. Educational Multimedia International, 37(1), 45–58.Google Scholar
 Passey, D. (2013). Inclusive technology enhanced learning: overcoming cognitive, physical, emotional and geographic challenges. New York, NY: Routledge.Google Scholar
 Pelgrum, W.J., & Law, N. (2009). ICT in Education around the world: Trends, problems and prospects. International Institute for Educational Planning. Retrieved from http://unesdoc.unesco.org/images/0013/001362/136281e.pdf.
 Pritchard, D., & Warnakulasooriya, R. (2005). Data from a webbased homework tutor can predict pupil’s final exam score. In World Conference on Educational Multimedia, Hypermedia and Telecommunications, Chesapeake, VA (pp.25232529).Google Scholar
 Pytel, B. (2007). Homework  What Research Says. Retrieved from http://educationalissues.suite101.com/article.cfm/homework_what_research_says.
 Radović, S., & Passey, D. (2016). Digital resource developments for mathematics education involving homework across formal, nonformal and informal settings. Curriculum Journal, 27(4), 538–559.Google Scholar
 Radović, S., Jezdimirović, J., & Marić, M. (2014). Interaktivna zbirka zadataka iz matematike za više razrede osnovne škole – eZbirka [Interactive workbook for mathematics for elementary school students  eZbirka]. Tehnika i informatika u obrazovanju – TIO 2014, 30–31. maj 2014. Tehnički fakultet Čačak, 5, 371–376.Google Scholar
 Razzaq, L., Feng, M., NuzzoJones, G., Heffernan, N. T., Koedinger, K. R., Junker, B., Ritter, S., Knight, A., Aniszczyk, C., Choksey, S., Livak, T., Mercado, E., Turner, T. E., Upalekar, R., Walonoski, J. A., Macasek, M. A., & Rasmussen, K. P. (2005). The assistment project: Blending assessment and assisting. In C. K. Looi, G. McCalla, B. Bredeweg, & J. Breuker (Eds.), Proceedings of the 12th International Conference on Artificial Intelligence in Education (pp. 555–562). Amsterdam: ISO Press.Google Scholar
 Rogers, P. L. (2000). Barriers to adopting emerging technologies in education. Journal of Educational Computing Research, 22(4), 455–472.Google Scholar
 Romero, C., Ventura, S., & García, E. (2007). Data mining in course management systems: Moodle case study and tutorial. Computers & Education, 51(1), 368–384.Google Scholar
 Roschelle, J., Feng, M., Murphy, R. F., & Mason, C. A. (2016). Online mathematics homework increases student achievement. AERA Open, 2(4), 1–12.Google Scholar
 Ruthven, K., Hennessy, S., & Brindley, S. (2004). Teacher representations of the successful use of computerbased tools and resources in teaching and learning secondary English, mathematics and science. Teaching and Teacher Education, 20(3), 259–275.Google Scholar
 Shanghai Municipal Education Commission. (1998). Annual report on basic education in Shanghai.Google Scholar
 Sinay, E., & Nahornick, A. (2016). Teaching and learning mathematics research series l: Effective instructional strategies (Research Report No. 16/17–08). Toronto: Toronto District School Board.Google Scholar
 Sinclair, N., & Jackiw, N. (2005). Understanding and projecting ICT trends in mathematics education. In S. JohnstonWilder & D. Pimm (Eds.), Teaching secondary mathematics effectively with technology (pp. 235–252). Maidenhead: Open University Press.Google Scholar
 Snoeyink, R., & Ertmer, P. A. (2002). Thrust into technology: How veteran teachers respond. Journal of Educational Technology Systems, 30(1), 85–111.Google Scholar
 Stevenson, H. W., & Stigler, J. W. (1992). The learning gap. New York: Summit Books.Google Scholar
 Stigler, J., & Hiebert, J. (1999). The teaching gap. New York: The Free Press.Google Scholar
 Sutherland, R. (2007). Teaching for learning mathematics. Maidenhead: Open University Press.Google Scholar
 Takači, Đ., Marić, M., Stankov, G., & Djenić, A. (2017). Efficiency of using VNS algorithm for forming heterogeneous groups for CSCL learning. Computers & Education, 109, 98–108.Google Scholar
 Tapscott, D. (2009). Grown up digital: How the net generation is changing your world. New York: McGrawHill.Google Scholar
 The Institute for the Advancement of Education. (2014a). Kreativna škola 2013/2014 [Creative school 2013/2014]. Retrieved from http://www.zuov.gov.rs/rezultati_konkursa_kreativna_skola.
 The Institute for the Advancement of Education. (2014b). Nastavni plan i program za peti razred osnovne skole [Curriculum for the fifth grade of primary education]. Retrieved from https://goo.gl/3XfuT6.
 Topper, A., & Lancaster, S. (2013). Common challenges and experiences of school districts that are implementing onetoone computing initiatives. Computers in the Schools, 30, 346–358.Google Scholar
 VanLehn, K., Lynch, C., Schulze, K., Shapiro, J. A., Shelby, R., Taylor, L., & Wintersgill, M. (2005). The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence in Education, 15, 147–204.Google Scholar
 Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186–204.Google Scholar
 Walker, A., Recker, M., Ye, L., Robertshaw, M. B., Sellers, L., & Leary, H. (2012). Comparing technologyrelated teacher professional development designs: A multilevel study of teacher and student impacts. Educational Technology Research and Development, 60(3), 421–444.Google Scholar
 Wong, C. K. (2001). Attitudes and achievements: Comparing computerbased and paperbased homework assignments in mathematics. Journal of Research on Technology in Education, 33(5).Google Scholar
Copyright information
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.