Conference logo
[ ASCILITE ] [ 2004 Proceedings Contents ]

An investigation of the motivational aspects of peer and self-assessment tasks to enhance teamwork outcomes

Catherine McLoughlin
Australian Catholic University
Joe Luca
School of Communications and Multimedia
Edith Cowan University
Teamwork and cooperative learning models are based on the premise that learning is best achieved interactively rather than through a one-way transmission process. In this study, the relationship between students' motivational orientation and the quality of learning in collaborative teams is investigated. A self-report measure of student self-efficacy and self-regulation was administered to students working on team-based assessment tasks, and correlated with performance data obtained from classroom assignments. The results showed that motivational beliefs were the best predictor of academic performance.


Introduction

While teamwork has always been part of university learning experience, this has often meant students simply interacting informally with each other outside formal teaching sessions. In more recent times, peer learning and peer assessment have been included as part of an organised learning experience with students being asked to work together to complete tasks and to engage in peer and self-assessment. For many students, this has meant moving beyond 'the comfort zone' of informal social interaction and taking on roles as peer assessors and collaborative, self-directed team members (Biggs, 1999; Boekaerts, 1997).

In addition, there is a growing emphasis in higher education institutions that students should be developing content knowledge as well as professional skills that can be directly applied in the workplace such as teamwork, problem solving skills, decision-making skills, communicative strategies and information literacy skills (Australian National Training Authority, 1998; Bennett, Dunne, & Carre, 1999; Candy, Crebert, & O'Leary, 1994; Dearing, 1997). Contemporary educational theory indicates that using self-regulation and self/peer assessment strategies in the learning settings are important elements needed to develop these skills (Boud, 1992; Loughram, 1996). These strategies in conjunction with online asynchronous communication tools can provide ideal motivational settings to help promote learning as well as professional skill development.

Peer review and self assessment tasks are alternative forms of assessment that involve individuals deciding what value their own, and each of their colleagues has contributed to a process or project, and enables students to engage in self-regulated activity. While positive finding have emerged from studies of peer assessment conducted in technology rich learning environments, there remains a need to investigate not only the cognitive aspects of such tasks and environments, rather than assuming that they provide optimal conditions for all learners (Jarvela, 1998). This study presents a teaching-learning environment that integrates teamwork with self/peer assessment strategies supported with an online application designed to motivate students and assist in supporting self-regulated learning. Two instruments are then used to assess students' metamotivational states (i.e. their awareness of their own goals, efficacy and motivational attitudes). Two major research questions are identified for investigation: First, whether there was a relationship between students' perceptions of teamwork and their performance on team assessment tasks, and second, whether there was any correlation between their motivational state and actual academic performance. In the investigation two questionnaires were designed to analyse the links between motivational orientation, impressions of teamwork and achievement scores.

Theoretical underpinnings of motivation and collaborative learning

Online collaborative learning is supported by sociocultural theory positing that an individual's cultural development appears twice and on two levels--first on the social, and later on the psychological level, first between people as an interpsychological experience, as an intrapsychological experience (Vygotsky, 1998; Bonk & King, 1998; Ge, Yamashiro & Lee, 2000)). In a learner-centered online collaborative environment, students work together to construct knowledge and negotiate meanings through group-based collaborative learning activities. Based on this theory assumptions can be drawn about collaborative learning and knowledge building, which require communication, collaboration and negotiation on the common ground of shared ideas, values and beliefs (Johnson & Johnson, 1996). Many recent practices have contributed to the growing body of knowledge on collaborative learning, for example, the use of online asynchronous environments for project and inquiry based learning (Collis, 1998). Harasim (1990) also emphasises that "team work enhances connectivity and socio-emotional engagement in the learning process, as well as creating an intellectual climate that encourages participation" (p.54). In other words, a well designed online environment is conducive to both learners' affective and cognitive development.

The literature also acknowledges that cognitive achievement and metacognitive strategies are not sufficient to promote student achievement, and that students must also be motivated to learn intentionally and in a self-regulated manner (Pintrich, 1989). Student motivation is underpinned by a number of theoretical models and theories. The most commonly applied is the expectancy value model of motivation (Schunk, 1994)). According to Pintrich & De Groot (1990), there are three motivational components that may be linked to the different models of self-regulated learning:

  1. An expectancy component: this includes students' beliefs about their ability to perform a task
  2. A value component: This includes students' goals and belief about the importance of the task
  3. An affective component: This includes students' emotional reactions to the task.

Linking motivation with self and peer assessment

Peer assessment involves individuals deciding on what value each of their colleagues has contributed to a process or project. Topping (1998) describes peer assessment as: "an arrangement in which individuals consider the amount, level, value, worth, quality, or successfulness of the products or outcomes of learning of others of similar status" (p. 249). This view is also supported by Falchikov (1995) who defines peer assessment as a process were individuals rate their peers by agreeing on appropriate assessment criteria and then accurately apply the assessment.

A review of the literature on self and peer assessment indicates that in order to promote the development of these skills, the environment should be designed to encourage participants to:

Self-assessment refers to people being involved in making judgements about their own learning and progress, which contributes to the development of autonomous, responsible and reflective individuals (Sambell, McDowell, & Brown, 1998; Schon, 1987). This is also supported by Boud (1992), who has expressed the defining characteristics of self-assessment as: "The involvement of students in identifying standards and/or criteria to apply to their work and making judgements about the extent to which they have met these criteria." (p. 5)

Both self and peer assessment can be used to help inform the design of the learning environment while building on motivational goals and improving self-regulation skills. The investigation centered on establishing links and possible correlations that might exist between achievement on the assessment tasks and the 3 motivational elements of assessment i.e., expectancy (self-efficacy beliefs), learners' goals and emotional reactions to the task.

Design of the learning environment

Learning activities were designed with a view to promoting self-regulation, team skills, social and peer accountability as well as reflection while working on authentic tasks (Figure 1). In week three of the semester, students were required to complete an online contract that outlined their responsibilities in the team. They then were able to complete confidential self and peer assessments about the progress of their peers, as stated on the contracts. These instructional strategies and tasks were designed to increase student motivation, self-efficacy and levels of self-regulation.

Figure 1

Figure 1: Design of the learning environment

Context of the study

This study was conducted with a 34 final year students (making nine teams), enrolled in the Interactive Multimedia course at Edith Cowan University (IMM3330 'Industry Project Development'). Project work was used in this unit to help meet industry needs, as well as supporting the development of students' professional skills (Collis, 1998; Klemm & Snell, 1996; English & Yazdani, 1999) such as leadership skills, collaboration, time management and decision-making. Students are required to work in teams tp develop web sites for industry clients with real business needs. This helps set an authentic context, in which teams of four are formed taking the roles of programmer, graphic designer, media developer or project manager.

Students are required to develop a project proposal (needs analysis, feasibility, scope and legal contract), design specification (storyboards, concept maps and rapid prototypes), metrics for costing the project, a product evaluation and address copyright/intellectual property issues. Students are also required to integrate and practice graduate attributes such teamwork and leadership skills.

The unit consists of 13, three-hour sessions over one full semester. Each session consists of a one-hour lecture followed by a two-hour tutorial. Team skills and collaboration are continually promoted with teams of four students working together to develop project management and generic skills. Student learning outcomes include:

Assessment includes the following:

A custom built online courseware management system was used to help deliver the coursework (see http://www.scam.ecu.edu.au/) and the unit was delivered in blended mode, combining face-to-face seminars with online learning tasks.

Methodology

Two questionnaires were given to each student at the end of the semester to measure both their impressions of teamwork and motivational orientation (see Table 1 & 2). Students were asked to respond to each set of questions designed to elicit their views on motivational aspects of the learning task and environment:

How the data was processed

The data collected from the questionnaires was collected into Excel spreadsheets and processed using averages and correlation coefficients (Pearson Product) to help synthesise the data into patterns of behaviour. Tables 1-3 illustrate how the data was processed for team 1. This same process was used for each of the other nine teams summarised in Table 4.

Table 1 shows the results for 'Impressions of Teamwork' obtained for team 1. Note that the responses were averaged to one decimal place (shown in the last row) using numeric values from the Likert scale:

Table 1: Results for team 1 - 'Impressions of teamwork'
Strongly Agree = 2; Agree = 1; Disagree = -1; Strongly Disagree = -2

Student Number 1  2  3  4 
1.The information and assistance provided by my peers during the semester was useful1111
2.The communication between me and my peers was positive and open11-1-1
3.My team-mates and I discussed our answers to the online questions to reach consensus1121
4.I would always ask my peers for assistance when I could not clearly understand a team activity or the online questions1-11-2
5.My peers valued my point of view and the information I rendered1211
6.I interacted with my peers to share my thoughts and ideas while completing the online activities1-1-1-1
7.I paid attention to what my peers were saying during discussions1111
8.Whenever my team-mates had trouble understanding how to do team based activities or the posted question, I would help them1111
9.There was much feedback provided within the group (by my peers)1-1-1-1
10.Overall, the teamwork activities complemented this unit-1111
Average = 0.80.50.50.1

Table 2 shows the results for 'Motivational Orientation' obtained from team 1, using the same Likert scale.

Table 2: Results for team 1 - 'Motivational orientation'

Student Number 1  2  3  4 
1.Compared with other students in this class I expect to do well12-11
2.I'm certain that I understood the ideas taught in this course-1-11-1
3.I expect to do very well in this unit11-11
4.Compared to others in this class, I think I'm a good student1212
5.I'm sure it did an excellent job on the problems and tasks assigned in this class-1-1-11
6.I think I will receive a good grade for this class-2-111
7.My study skills are excellent compared to others in this class-1-11-1
8.Compared with other students in this class I think I know a great deal about this subject-1-1-11
9.I know that I will be able to learn the material for this exam-1111
10.I prefer class work that is challenging so I can learn new things1-111
11.It is important for me to learn what is/was being taught in this class111-1
12.I am studying to satisfy my own interests and not to get good grades12-21
13.I think I will be able to use what I learn in this class in other contexts1-1-21
14.I often choose topics I will learn something from even if they require more work11-2-1
15.Even when I do poorly on an assessment I try to learn from my mistakes12-21
16.I think that what I am learning in this class is useful for me to know11-2-2
17.I think that what we are learning in this class is too theoretical to be of value1-111
18.When I find a problem, I am usually able to work it out for myself1-11-1
19.I am not nervous doing assessments/exams and I remember facts I have learnt1221
20.I do not have an uneasy feeling when I submit an assignment111-1
21.I do not worry a great deal about assignments-1111
22.When I do an assignment I don't think about how poorly I am doing-11-2-1
23.I am able to judge how well I am doing in this subject without teacher assistance1-1-21
Average = 0.30.3-0.20.3

These averages shown at the bottom of table 1 and 2 were then tabulated against the team assignment mark as well as individual student exam marks (Table 3).

Table 3: Average scores for team 1

Stud
No.
Teamwork
Impressions
Motivational
Orientation
Team
Assignment /50
Individual
Exam /50
1.0.80.32935
2.0.50.32931
3.0.5-0.22928
4.0.10.32915
Avg0.480.172927

Results and discussion

The process used to obtain the average scores for team 1 (shown in Table 3) was then performed for each of the other eight teams. The average scores for the nine teams are shown in Table 4 below, sorted by 'Motivational Orientation'.

A Pearson product moment correlation coefficient was calculated between 'Teamwork Impressions' and 'Team Assignment' mark as well as 'Individual Exam' mark. This was also performed for 'Motivational Orientation'. The following significant results were obtained:

Table 4: Average scores for all teams, sorted on 'Motivational' scale

Team
No.
Teamwork
Impressions
Motivational
Orientation
Team
Assignment /50
Individual
Exam /50
30.180.674238
70.300.644034
90.430.523935
20.230.633734
6-0.030.623734
40.220.333331
80.300.443128
50.230.183029
10.480.172927

These results in this case study illustrate that 'Motivational Orientation' was a strong predictor of team assignment and individual exam scores. This implies that students who work in a self-motivated way will have a greater chance of getting better marks. For example, results from the motivational orientation questionnaire showed that in teams where there were high levels of self-efficacy and intrinsic motivation, there was also high achievement in team assignments and individual exam scores.

The 'impressions of teamwork' questionnaire responses showed that not all aspects of the team processes were positive. For example, items 6 and 9 received negative ratings, indicating that some students found the inter-team feedback and communication processes to be less than satisfactory. This result was reflected in the weak correlation between the questionnaire responses and team assignment marks. This contrasts with the positive motivational attitudes displayed by students in the 'Motivational Orientation' instrument.

Overall the results show that indicators of positive emotional states did have an impact on academic performance. For example, students who believed they were capable learners also reported the utilisation of positive team behaviours. The results are supported by previous work in the area of motivational orientation and cognitive achievement (Zimmerman, 2000). In addition, the focus on motivation in context, as depicted in the present study, highlights the significance of mutual reciprocal influences of individuals and contextual variables, and how the dynamics of self-perceptions and goals affect motivation and performance.

Conclusion

In this student-centered learning environment, learners were given actual control and self-direction of academic tasks through task and assessment design, thereby enhancing motivational effects. However, the imitations of the study need to be discussed. First, students' metamotivation states were investigated largely through the use of two self-report instruments. While such instruments are a useful starting point for investigating affective aspects of learning environments, they need to be augmented with other measures and data, such as self-reports, interviews and think aloud protocols on order to obtain a rich corpus of data. Nevertheless, these preliminary results indicate that the there is sufficient evidence of the importance of considering motivational dimensions and self-regulated learning effects of learning activities and environments. Motivational beliefs are always hidden and covert, and while students may appear to be working within their 'comfort zones', it is revealing and telling when we delve beneath the surface to investigate deeper attitudes and beliefs about their levels of anxiety and perceptions of the learning process. The results, though small scale indicate that leamers' capacity to engage in deep and generative learning is closely linked to efficacy beliefs, motivational states and levels of confidence. Educators and designers of learning task therefore need to investigate these affective dimensions of the learning process in order to develop more challenging zones of engagement for learners.

References

Australian National Training Authority (1998). Australia's national strategy for vocational education and training 1998-2003. Canberra: Commonwealth of Australia. [verified 31 Oct 2004] http://www.anta.gov.au/images/publications/bridge-to-the-future.PDF

Bennett, N., Dunne, E. & Carre, C. (1999). Patterns of core and generic skill provision in higher education. Higher Education, 37(1), 71-93.

Biggs, J. (1999). Teaching for quality learning at university. Buckingham: Open University Press.

Boekaerts, M. (1997). Self-regulated learning: A new concept embraced by researchers, policy makers, educators, teachers, and students. Learning and Instruction, 7(2), 161-186.

Bonk, C. J. & Kim, K. A. (1998). Extending socio-cultural theory to adult learning. In M. C. Smith & T. Pourchot (Eds), Adult learning and development: Perspectives from educational psychology (pp. 67-88). Mawah: NJ: Lawrence Erlbaum Associates.

Boud, D. (1992). The use of self assessment schedules in negotiated learning. Studies in Higher Education, 17(2), 185-200.

Candy, P., Crebert, G. & O'Leary, J. (1994). Developing lifelong learners through undergraduate education. Canberra: Australian Government Publishing Service.

Collis, B. (1998). WWW-based environments for collaborative group work. Education and Information Technologies, 3, 231-245.

Dearing, R. (1997). Higher education in the learning society. London: HMSO. [verified 31 Oct 2004] http://www.leeds.ac.uk/educol/ncihe/

English, S. & Yazdani, M. (1999). Computer-supported cooperative learning in a virtual university. Journal of Computer Assisted Learning, 15(2), 2-13.

Falchikov, N. (1995). Peer feedback marking: Developing peer assessment. Innovations in Education and Training International, 32, 175-187.

Ford, A. (1997). Peer group assessment: Its application to a vocational modular degree course. Journal of Further and Higher Education, 21(3), 285-298.

Ge, X., Yamashiro, K. A. & Lee, J. (2000). Pre-class planning to scaffold students for online collaborative learning. Educational Technology and Society, 3(3), 159-167. http://www.ifets.info/journals/3_3/b02.html

Harasim, L. (Ed.). (1990). Online Education: an environment for collaboration and intellectual amplification. New York: Praeger.

Jarvela, S. (1998). Socioemotional aspects of students learning in a cognitive apprenticeship environment. Instructional Science, 26, 439-471.

Johnson, D. W. & Johnson, R. T. (1996). Cooperation and the use of technology. In D. H. Jonassen (Ed), Handbook of research for educational telecommunications and technology (pp. 1017-1044). New York: Simon & Schuster.

Klemm, W. R. & Snell, J. R. (1996). Enriching computer-mediated group learning by coupling constructivism with collaborative learning. Electronic Journal of Instructional Technology, 1(2). http://www.usq.edu.au/electpub/e-jist/docs/old/vol1no2/article1.htm

Klenowski, V. (1995). Students' self-evaluation processes in student-centred teaching and learning contexts in Australia and England. Assessment in Education, 2(2), 145-163.

Loughram, J. (1996). Developing reflective practice: Learning about teaching and learning through modelling. London: Falmer Press.

Oldfield, K. A., & MacAlpine, M. K. (1995). Peer and self assessment at tertiary level-an experiential report. Assessment and Evaluation in Higher Education, 20(1), 125-132.

Orsmond, P., Merry, S. & Reiling, K. (1996). The importance of marking criteria in the use of peer assessment. Assessment and Evaluation in Higher Education, 21(3), 239-250.

Pintrich, P. R. (1989). The dynamic interplay of student motivation and cognition in the college classroom. In C. Ames & M. Maehr (Eds), Advances in motivation and achievement: Vol 6 (pp. 117-160). Greenwich; CT: JAI Press.

Pintrich, P. R. & De Groot, E. V. (1990). Motivational and self-regulated components of classroom academic performance. Journal of Educational Psychology, 82(1), 33-40.

Sambell, K., McDowell, L. & Brown, S. (1998). "But is it fair?": An exploratory study of student perceptions of the consequential validity of assessment. Studies in Educational Evaluation, 23, 349-371.

Schunk, D. H. (1991). Self-efficacy and academic motivation. Educational Psychologist, 26, 207-231.

Schon, D. A. (1987). Educating the reflective practitioner: Towards a new design for teaching and learning in the professions. San Francisco, CA: Jossey-Bass.

Sluijsmans, D., Dochy, F. & Moerkerke, G. (1999). Creating a learning environment by using self- peer- and co- assessment. Learning Environments Research, 1, 293-319.

Stefani, L. A. J. (1994). Peer, self, and tutor assessment: Relative reliabilities. Studies in Higher Education, 19(1), 69-75.

Sullivan, K. & Hall, C. (1997). Introducing students to self-assessment. Assessment and Evaluation in Higher Education, 22(3), 289-305.

Topping, K. J. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249-276.

Topping, K. J., Smith, E. F. & Swanson, I. (2000). Formative peer assessment of academic writing between postgraduate students. Assessment and Evaluation in Higher Education, 25(2), 149-166.

Vygotsky, L. (1998). Mind in Society. Cambridge: Cambridge University Press.

Yu, F. Y. (2003). The motivating effects of anonymity and proximity in an online sychhronised competitive learning environment. Journal of Educational Computing Research, 29(2), 153-167.

Woolhouse, M. (1999). Peer assessment: The participants' perception of two activities on a further education teacher education course. Journal of Further and Higher Education, 23(2), 211-219.

Zimmerman, B. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich & M. Zeidner (Eds), Handbook of self-regulation (pp. 13-39). San Diego CA: Academic Press.

Authors: Catherine McLoughlin, Australian Catholic University, Australia. c.mcloughlin@signadou.acu.edu.au
Joe Luca, School of Communications and Multimedia, Edith Cowan University. j.luca@ecu.edu.au

Please cite as: McLoughlin, C. & Luca, J. (2004). An investigation of the motivational aspects of peer and self-assessment tasks to enhance teamwork outcomes. In R. Atkinson, C. McBeath, D. Jonas-Dwyer & R. Phillips (Eds), Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference (pp. 629-636). Perth, 5-8 December. http://www.ascilite.org.au/conferences/perth04/mcloughlin.html

© 2004 Catherine McLoughlin & Joe Luca
The authors assign to ASCILITE and educational non-profit institutions a non-exclusive licence to use this document for personal use and in courses of instruction provided that the article is used in full and this copyright statement is reproduced. The authors also grant a non-exclusive licence to ASCILITE to publish this document on the ASCILITE web site (including any mirror or archival sites that may be developed) and in printed form within the ASCILITE 2004 Conference Proceedings. Any other usage is prohibited without the express permission of the authors.


[ ASCILITE ] [ 2004 Proceedings Contents ]
This URL: http://www.ascilite.org.au/conferences/perth04/procs/mcloughlin.html
HTML created 30 Nov 2004. Last revision: 30 Nov 2004.