Title: External peer-review of the quality of learning objects

Presenters:

Peter G. Taylor and colleagues
Griffith Institute for Higher Education
Mt Gravatt Campus
Griffith University
Email: peter.taylor@mailbox.gu.edu.au

Introduction

This workshop will share progress in the development of a system-wide scheme to provide independent expert review of the quality of the ICT-based learning objects developed to support student learning in Australian universities. The operationalisation of the scheme depends on collaboration between universities, journal editors, resource creators and expert reviewers, and the AUTC-funded project, "Information and Communication Technologies and Their Role in Flexible Learning".

Intended audience:

This workshop is intended for the widest possible audience of ASCILITE participants. The scheme has direct relevance to:

• anyone involved in supporting the development of learning objects;
• anyone interested in the validation of the quality of learning objects;
• anyone interested in participating in the scheme either as contributors of learning objects for review, or undertaking the role of reviewer;
• anyone interested in the use of meta-data to assist in the discovery of learning objects.

Objectives:

Those who attend will:

• gain a clear understanding of how the scheme is operating in this trial phase;
• explore examples of reviewed resources and the review process;
• experience the review process;
• have the opportunity to discuss how they might make use of the scheme and its outcomes.

This workshop will provide an opportunity for conference participants to engage with a project to develop a national scheme to provide peer review of ICT-based teaching and learning resources, ie, 'learning objects'. The project involved an initial development of the conceptual and procedural resources necessary for the implementation of the scheme. That stage of the project was supported by EIP funding by DETYA, completed in 2000, and reported in Taylor and Richardson (2001).

The workshop will introduce participants to the operation of the scheme through inviting their engagement with the procedures and resources developed during the trial stage of the scheme, begun in November 2000, and continuing until the end of 2001. HEIP funding support for this work has been provided by DETYA.

We believe that this work will be of considerable interest to ASCILITE members given its focus on validating the quality the scholarship of teaching (Boyer 1990) that is evidenced in and through the design and construction of learning objects. It also builds on the work of Carmel McNaught, Rob Phillips, Darrien Rossiter and Jenny Winn, reported in the EIP report "Developing a Framework for a Useable and Useful Inventory of Computer-facilitated Learning and Support Materials in Australian Universities" (McNaught et al 2000). The development of a framework to guide those involved in the review process is seen as a significant contribution to efforts to develop a shared understanding of the essential elements of effective design of teaching. This framework has been aligned with the work of the AUTC-project group (mentioned above), led by Barry Harper, Ron Oliver and John Hedberg. The framework can be readily adapted for use in personal reflection of teaching, review by students, and/or review by 'local' peers, as is being trialed by staff at James Cook University. Thus the resources developed through the project should contribute to the recognition and reward of highly effective teaching irrespective of whether that teaching involves the use of ICTs.

In particular, the workshop will provide an overview of the operation of the scheme and access to the resources developed to support both the trial of the scheme. That trial is being conducted in Edith Cowan University, Griffith University, James Cook University, RMIT, the University of Sydney, and the University of Wollongong. The workshop will provide an opportunity for participants to gain an insight into the schemes' operation and potential, including an opportunity to use the Review Proforma to review sets of resources.

Staff development resources have been developed to introduce the scheme to three key stakeholder groups: journal editors; resource creators; and, potential peer reviewers. In addition staff development strategies and resources have been developed for use within institutions to introduce the scheme to those involved in staff selection and promotion committees. These strategies and resources are being trialed.

Our intention is to provide workshop participants with an opportunity to explore and provide feedback on the scheme and the resources that have been developed to support its implementation. That feedback will be used to assist us in the ongoing establishment of the project, while the workshop will assist in the expansion of the scheme.

References:

Boyer, E. (1990) Scholarship revisited; priorities of the professoriate. New Jersey: The Carnegie Foundation for the Advancement of Teaching.

McNaught, C., Phillips, R., Rossiter, D. & Winn, J. (2000) Developing a Framework for a Useable and Useful Inventory of Computer-facilitated Learning and Support Materials in Australian Universities. EIP Report 99/11. DETYA; Canberra. Available at: http://www.deetya.gov.au/highered/eippubs.htm

Taylor, P.G. and Richardson, A.S. (2001) Peering at Scholarship in University Teaching: Constructing a national scheme for external peer review of ICT-based teaching and learning resources. Draft EIP report, sent to DETYA on 20 October 2000.

Workshop presenter:

Peter Taylor is a Senior Lecturer in the Griffith Institute for Higher Education at Griffith University. The focus of his work is staff, student, and organisational development for flexible learning, including the design, use and research of new learning environments. He has over 25 years experience as a teacher, and been engaged in academic staff development for the last seven years. Peter's research interests cover a wide spectrum - pedagogy, flexible learning, and academic life. In 1999 the Open University Press published his book Making Sense of Academic Life: Academics, Universities and Change.

The workshop will also be supported by other members of the Project Team, including Craig Zimitat and Brad Young.