
compass on map
Sometimes in the midst of a long, involved project it’s difficult to recognize and appreciate how far you have traveled.
The selection of a new LMS has been such a journey for the Online Course Development team. Spending time this month and next revisiting the path we have taken is not only informative for PLS staff members but a great reflection time for us.
Over the past two weeks, we have revisited the LMS investigative process and indepth usability testing that helped bring us to our current position with Sakai implementation. In our early planning, we determined a process framework that we used as a guide. Our next destination or step in the process was to conduct a pilot.
As previously discussed, we narrowed our choices to two systems, testing both with a group of simulated users. Usability testing gave us a good view of the two systems and great information to build on. However, a more indepth testing environment with a longer timeline and real facilitators was needed to ensure the right selection for PLS staff and students.
In December of last year (2007), we proposed conducting two concurrent pilots. The decision-makers at PLS agreed (thank you!). Conducting a pilot of two very different systems, required the team and other PLS staff to participate in training and development for both systems, a big time investment by everyone involved. One system’s training involved 4-weeks with daily activities required. The other a 4-hour webinar.
At the conclusion of the training, the team created Pilot Course sites in each system using identical content. Adjustments were made to the Pilot Course sites based on usability testing for each system and in general. A PLS facilitator served as instructor for both courses in an effort to elliminate unneeded variables and detractors.
The pilot for the first LMS began March 27th and ended on April 9th; the second LMS pilot began April 11th. Participants in the second pilot encountered login issues unrelated to the LMS. In an effort to cleanly evaluate the LMS, we determined that a second, fresh attempt at a pilot course was needed. We began a 1 1/2 week pilot of the second LMS beginning May 2nd and ending May 14th. Participants included individuals who participated in both of the previous pilots in addition to three Online Course Mentors. While this second pilot impacted our selection schedule, we felt it was worth the time to get valid feedback about the LMS.
After much discussion and assessment of feedback and data from the pilots, Sakai was selected as our new LMS. That was Tuesday, May 20th. So, had we reached our destination? Not even close! Training was the next leg of our journey. During the four weeks of January, we continue our reflective travels. We hope you will follow along, take a few pictures, write a postcard and remember a quote from Ben Sweetland… “success is a journey, not a destination.”

