** This page is unpublished **


Integrating Portfolios with OSP at Portland State

Wende Morgaine wende@pdx.edu, Nate Angell angell@pdx.edu, Portland State University


Why use OSP?

  • Capacity for in-house customization
  • Integration into a collaborative learning environment (Sakai)
  • Opportunity for Portland State to share best practices from 12 years of portfolio use with the higher education community also implementing OSP
  • Provides an asset-based medium for students to demonstrate proficiencies
  • Evaluates through an authentic assessment based on a comprehensive and thorough examination of student work
  • Portability for students’ lifelong use after graduation and across institutions
  • Provides sustainable, extensible medium for faculty portfolios that could be used in annual review and promotion and tenure


Background and Context

Portland State is now in our twelfth year using portfolios systematically in the freshman courses of University Studies--our award-wining general education program. In 1999, University Studies moved from paper portfolios to web-based "eportfolios." In 2003, Portland State began looking for a enterprise eportfolio system, seeking to expand our use of portfolios across the general education program, to provide additional structure within portfolios to facilitate assessment, to reduce course time spent teaching web design, and to enhance the security of student work on the internet. The Open Source Portfolio met many our needs.

As a part of an innovative university--nationally recognized for both for its general education program and for its wide-spread use of community-based learning--Portland State’s faculty bring an awareness of and appreciation for reflective thinking in the academic context. As pioneers in the field of portfolios, expanding eportfolio use throughout our general education program and all departments/programs is something our institutional/faculty culture welcomes.


Impact of Use

We see a variety of impacts of open/community source adoption across our campus. First and foremost, we are excited about spreading portfolio practice to other departments and programs. This practice alone will result in:

  • Students’ connecting assignments and courses throughout their college career--in both their general education courses and in the courses for their major
  • Visual representation of program/department goals, increasing student understanding of those goals
  • Increasing student ownership of their educational journey and choices, contributing to their development as life-long learners

At Portland State, we can see the many positive impacts of OSP use in every area of university life, including:

  • recruitment of prospective students and faculty
  • innovations in the classroom
  • increasing our ability to collect and share the stories of success within our institution
  • facilitating research collaboration across the globe
  • improving relationships with alumni and emeriti faculty

"The Sakai is the limit."


Goals, Users, Processes, Activities

Goals

  • Expand the practice of eportfolios throughout all four years of our University Studies general education program
  • Integrate eportfolio practices with general teaching and learning activities in the context of an enterprise learning management system
  • Incorporate eportfolio use into departments and majors across campus
  • Faculty use of eportfolios for promotion and tenure, as well as annual review
  • Utilize OSP for institutional portfolio and aggregating data across campus
  • Utilize OSP to showcase student and faculty work for external audiences

Users

In the 2004-2005 and 2005-2006 academic years, our users of the Open Source Portfolio were all students, faculty, and mentors in University Studies. In the 2006-2007, we will expand that use to at least three departments.

In the 2004-2005 academic year, our users of Sakai were also all students, faculty, and mentors in University Studies. However, during the 2005-2006 academic year, we piloted almost twenty courses in Sakai 2.0 with approximately 500 new users. Depending on the outcome of our Sakai pilot and our evaluation of other learning management systems, by the end of the 2006-2007 academic year, we expect to have transitioned our remaining 22,000 users to Sakai as the sole LMS used at the institution.

Processes

Although other open source and commercial systems for eportfolios were considered here at Portland State, the Open Source Portfolio was the best fit for Portland State, given the availability of a commercial affiliate to host a pilot and thus avoid an institutional commitment of staff and hardware during the initial evaluation period. Our first two pilots were funded by a one-time grant from a student technology fee fund.

Before our first pilot of the OSP, we held meetings with faculty for a year to learn what parts of their web-based portfolio pedagogical process was effective and required for within eportfolio software. Even once we committed to the first pilot of the OSP, the commercial affiliate we choose to assist us (rSmart) engaged our core faculty in discussions about their pedagogy for over two days before customizing the design of the eportfolio we used Spring term 2005. Listening to our faculty and incorporating their requirements was the first and most important step in our successful implementation at Portland State. Our first pilot of OSP was in University Studies (in three of four levels.) Six faculty had almost 300 students in 8 different courses use OSP (and in some cases, Sakai.)

In addition to piloting OSP, the head of our IT department that provides instructional design and administers our course management system attended Community Source Week 2005 to investigate use of Sakai at Portland State. Given Sakai’s maturity demonstrated at Community Source Week, Portland State decided to pilot Sakai as an alternative to our current WebCT system. Without that support for Sakai, plans for widespread use of OSP at Portland State would have been difficult to envision. Having an advanced Java programmer on one of our IT support teams was also a critical factor in adoption of both OSP and Sakai.

Following that first, Spring 2005 pilot, one of our piloting faculty was so impressed with how OSP/Sakai improved her classroom practices and student learning outcomes that she requested to use it again in her two courses during Summer term 2005. Seeking feedback on OSP at every level of our general education program before expanding use of it across campus, planned one additional pilot during the 2005-2006 academic year.

With a successful outcome from Portland State’s OSP and Sakai pilots, OSP will be implemented throughout our University Studies program during the 2006-2007 academic year, reaching at least 14,000 students annually. Full integration into that curriculum should take at least three years. Also during the 2006-2007, we will begin piloting use of the OSP in three to five departments across campus. After developing a model of departmental implementation, we hope to see full departmental integration across our large, urban campus in five years.

One crucial aspect of our process at Portland State has been to seek buy-in at appropriate intervals. We sought faulty support before the initial pilot. We worked with and enhanced the existing open source ecosystem on campus with our IT departments before drawing up large-scale implementation plans. We worked to ensure that OSP use across campus aligned with institutional values and obtained backing from administrators in order to carry out our large-scale implementation plans. Without those crucial people and departments at Portland State championing OSP, our use would not have been as successful and would not have led to the wide implementation we now envision.

Activities

At Portland State, our use of OSP is unique in that it is primarily pedagogical. Although OSP has many innovative uses for student advising, career development, and enhancing lifelong alumni relationships, our plan begins with utilizing OSP’s pedagogical functionalities and widens to its other uses in future phases of our implementation.

At Portland State, we have used OSP in our existing portfolio assignment in our first year University Studies courses. That program has four learning goals:

  • Inquiry and Critical Thinking
  • Communication
  • The Diversity of Human Experience
  • Ethics and Social Responsibility

These goals are the rows of our OSP matrix for University Studies. In addition, students progress through four levels of that program:

  • Freshman Inquiry
  • Sophomore Inquiry
  • Junior Cluster
  • Senior Capstone

Those levels are the columns of our OSP matrix for University Studies.

Students collect assignments over the course of the term and populate the cells in one column of the matrix with their work (demonstrating progress in each program goal.) They then reflect on their work, how it demonstrates their progress toward the goal, and other questions individually assigned by faculty. Although this reflective practice/assignment is used throughout our University Studies courses, the time needed to teach web-design has prevented us from using web-based portfolios at every level of our program. Reducing the need for deeper technical user training, OSP will enable us to use eportfolios in every University Studies course.

Given our experience in our pilots, using OSP within the collaborative learning environment of Sakai is vital. If students are always in the system, accessing assignments, contributing to the discussion, utilizing resources, etc., then it is natural for them to be saving all their work for that class in their OSP repository/collection. When they populate their matrix, they do so from the richness of their entire academic experience. Thus, they can make real choices about which assignments demonstrate their progress toward a goal within the matrix. Using OSP within Sakai creates an environment in which the portfolio isn’t an added assignment. It’s a reflective process that helps students connect their academic experiences across courses and thus make meaning of their learning.


Challenges, Issues, and Innovations

Challenges

Because the development of OSP and Sakai is done in community and through institutions donating developer and faculty time, Portland State already has multiple uses for many of these tools once their integration is complete. We are eager for that integration to continue and move more quickly.

Issues

The scale of implementation we are planning at Portland State demands a lot of resources from our institution. Although smaller scale use of OSP can have a dramatic and worthwhile effect at institutions unable to dedicate resources to campus-wide implementation, we see OSP and other open/community source applications as good tools to address needs our institution has.

Also, as we moved forward with OSP/Sakai use, we have realized the need for a coordinator of our implementation plan. It took two terms of use to understand how vital that staffing was for the success of our efforts. As we proceed with widespread open/community source adoption on our campus the duties of the implementation coordinator grow. Additional staffing is required.

Finally, in our first pilot, we did not spend enough time training our faculty before the pilot began. We also choose to use a pre-release version of OSP 2.0 and experienced the to-be-expected bugs. But technical problems can hinder faculty adoption of new software, so we are now dedicated to working very closely with our faculty to give them over-the-top technical support. We have learned a lot from the technical support model discussed by the University of Minnesota faculty at Community Source Week 2005. We adopted this model and found it has improved faculty receptivity to the new software.

Innovations

Because OSP is still a young toolset, at Portland State we were very lucky to become involved in its development early on and contribute some of our long-standing pedagogical practices to the community. Our use of OSP in the classroom to facilitate student work on program goals is novel for OSP 2.0.

Also pioneering is our intertwined use of OSP and Sakai. Although many schools use one or the other, few use both. We have certainly found that using both is key to the optimal success of using OSP pedagogically.

Along with schools around the country, we are beginning to examine adapting OSP/Sakai tools for use with faculty promotion and tenure, along with considering using OSP for our institutional portfolio.

We see moving to the use of open/community source on our campus as a way to shift our resources investments to technology that enriches the higher education community, to integrate all the great work being done on our campus, and to share the stories of our innovative work in academe.


Recommendations

  • Use OSP within full use of the tools of the Sakai collaborative learning environment
  • Start with small pilots and use the success of the software in the classroom as a basis for expanding use
  • Secure faculty and IT buy-in before moving too far along
  • When you are first trying out OSP, considering using a commercial affiliate for pilot hosting
  • Allow more time than you think you need to train faculty on the software before beginning a pilot
  • Appoint an enthusiastic faculty member (as opposed to someone from IT) to manage the implementation of OSP as other faculty will be more open if technology is being used for pedagogical rather than technological reasons
  • Immediately become involved in the Open Source Portfolio and Sakai communities--attend conferences, subscribe to and ask questions on the lists, etc.
  • Align the areas in which OSP can improve practice with your institutional values and with solving existing institutional problems. For instance, we started use of OSP in a program where the faculty culture already embrace the practice of portfolios, but had some complaints with the technology of the portfolio assignment.
  • Avoid institutional creep by securing the buy-in of the administration before the software becomes vital to mission critical operations


Technical Information

Portland State currently uses WebCT Campus Edition (4x) as a learning management system and Banner 7x for student, course, financial information system.

OSP/Sakai Piloting

  • Fall 2005 OSP 2.0/Sakai 1.5 and Sakai 2.0 on 2 x 3.0 GHz CPU Dell server with 4 GB of RAM, using MySQL
  • Summer 2005 OSP 2.0/Sakai 1.5, hosted by rSmart
  • Spring 2005 OSP 2.0 (RC5)/Sakai 1.5, hosted by rSmart

OSP/Sakai Production

  • OSP 2.0/Sakai 1.5 and Sakai 2.1 together on Cluster of 5 2x3.0 GHz CPU, 4 GB RAM servers, using MySQL
  • MySQL: 2x3.0 GHz CPU, 6 GB RAM server with redundant FC interface connected to the SAN for storage





This electronic portfolio was created using the KEEP Toolkit™, developed at the
Knowledge Media Lab of The Carnegie Foundation for the Advancement of Teaching.
Terms of Use - Privacy Policy