CS 260A - Unix/Linux System Administration - Stage 3 - Greg Boyd

Assessment

Assessment Methods
  • Analysis of exam, quiz, or homework items linked to specific SLOs
  • Direct observation of performances, practical exams, group work
Assessment DescriptionThe SLOs were assessed from the final project (configuration of a virtual machine) and from the Final Exam.
Learning OutcomesThe following SLO work was undertaken for Spring 2013:

1. Enhancement of the exercise set that deals with installation of packages, the addition of the topic to the online notes, and the re-evaluation of the following [updated] SLO:

M. Install packages

2. the evaluation of two new course SLOS:

F. Create physical partitions and configure encrypted and unencrypted filesystems on them.

G. Create and configure logical volumes.
Number of Sections1
Number of Instructors1
Number of Students9

Data Analysis

Data Shared With

results were just compiled

Data Sharing Methods

None

Data SummaryM. Install packages.

This SLO was analyzed first in Fall 2012 and the results were less than stellar. Although it was not possible to add the topic to the online notes for this semester, it was covered more completely in lecture and the exercise set was enhanced to practice the topic. For comparison, two of the same problems were used on the final exam to test students' abilities, and two additional questions were added. The problems, with their success rates in Fall 2012 and Spring 2013 are shown below:

inquire what package provided a particular program (47% Fall, 66% Spring)

removing a package (53% Fall, 100% Spring)

inquire what version of a particular package is installed (not tested Fall, 89% Spring)

install a package after downloading it (this uses a different command) (not tested Fall, 55% Spring)

These numbers are better, but still need improvement. The SLO will be revisited at a later date.

F. Create physical partitions and configure encrypted and unencrypted filesystems on them.

G. Create and configure logical volumes

These two related SLOs which are central to the course were tested in two settings this semester:

1. The final project contained a section for creating partitions, swap, and logical volumes. This was implemented on a virtual machine, and the machine was submitted for grading.

2. The final exam contained an involved sequence of creating an encrypted logical volume.

100% of students succeeded in the configuration for the assignment. Thus, given ample time and resources, all students were able to complete the tasks.

On the final exam, the following results were noted

55% of students were able to perform all tasks successfully

11% of students had the correct steps for the task, but the incorrect order

11% of students completed most of the task, but forgot a significant step

22% of students completed the task with minor, but significant, mistakes

Considering the complexity of the task, this was deemed acceptable.
Analysis SummaryThe results for SLO M were obviously better this semester, and it was heartening that students were able to complete the other SLO tasks on an assignment - however, given a page of notes on the Final Exam, they were not able to detail the steps required to complete these last two tasks.

The final measure of student 'success' in these tasks must be left to whether they can perform such tasks in a time-constrained certification exam setting. This course (CS260A) is not prepared to measure that success, but the follow-on class (CS260P) is. The question of whether this course prepares students for success in CS260P (and hence the certification exam) is perhaps a question for the Program level SLO analysis. (It will be addressed in the next CS260P section in Spring 2014.)
Next Steps PlannedThe most significant problem this course has is the amount of material it must cover. With each update of Linux, the amount of material needed by a System Administrator increases, and the students are reflecting the strain. The attrition rate of the course, which dropped in Fall 2012, has risen again in Spring 2013.

To address this problem, a major restructuring of the course will take place for Fall 2013:

1. Each topic will be divided into required and optional sections. The optional sections will contain material not required by the industry certification exams that this course prepares students for, but deemed important background and extensions for that material. The students will be encouraged to study the optional material, but will not be tested on it (although it may be required for assignments)

2. Topics will be redistributed in the course to try to smooth out the workload over the semester.

3. Certain requirements of the course, such as taking notes on the exercises done and keeping a log of changes to virtual machines will be dropped. They added too much overhead.

4. The central assignment will be expanded to a project and implemented in phases. The result will be an installable package of the student's creation, which will give better insight into how packages work.
Learning OutcomesAgain, the purpose of this restructuring will be to improve the attrition rate. For comparison, the attrition rate of Spring 2013 is shown below:

students enrolled in class after the first week: 24

students handing in the first assignment: 19

students handing in the last assignment: 8

By having larger numbers of students completing the course a better measure of the program outcomes will be possible.

Changes

DetailsA complete rewrite of this course to align it with the industry-standard RHCSA certification exam was pending in Fall 2012, but could not be approved by Curriculum that semester. This update was accepted by curriculum in February 2013. It updates the remaining SLOs.
Learning OutcomesThe SLOs have been updated.

Tentative Future Plans

TermFall 2013
Activities
  • Assessment (measurement) of outcomes
  • Implementation of planned changes and reassessment
More Detailsa major restructuring of the course will take place for Fall 2013:

1. Each topic will be divided into required and optional sections. The optional sections will contain material not required by the industry certification exams that this course prepares students for, but deemed important background and extensions for that material. The students will be encouraged to study the optional material, but will not be tested on it (although it may be required for assignments)

2. Topics will be redistributed in the course to try to smooth out the workload over the semester.

3. Certain requirements of the course, such as taking notes on the exercises done and keeping a log of changes to virtual machines will be dropped. They added too much overhead.

4. The central assignment will be expanded to a project and implemented in phases. The result will be an installable package of the student's creation, which will give better insight into how packages work.

Due to the intensity of this work, a single SLO will be evaluated in Fall 2013:

J. Use archiving and compression utilities to archive and restore data.

SLO Details Storage Location

ELECTRONIC COPY - In my electronic filing system (hard drive or web server), http -//fog.ccsf.edu/~gboyd/SLO/Spring2013/CS260A

Back to Department Overview