ASTR 16 - Observational Astronomy - Stage 5 - Todd Rigg Carriero

Assessment

Assessment Methods

Pre & post surveys or tests

Assessment DescriptionTOAST is used as an assessment tool of Course-Level Student Learning Outcomes (SLOs). The Test Of Astronomy STandards (TOAST) Assessment Instrument underwent iterative development, showing that it has a high degree of reliability and validity. This multiple-choice test is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. TOAST can help measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community.
Learning OutcomesALL
Number of Sections3
Number of Instructors2
Number of Students~15

Data Analysis

Data Shared With
  • Instructors of the same course (at CCSF)
  • Faculty and staff within our department
Data Sharing Methods

Face-to-face meetings

Data SummaryOn average across 1 of 3 sections, the students answered correctly 10 out of 15 questions on the TOAST pre-test and 9 out of 15 on the posttest. Two questions consistently chosen incorrectly on pre- and posttest showed minor improvement, but the prime distracter in each case showed a minor increase as well. One, based upon Wein’s Law, and the other based upon the causes of the seasons. The negative gain is of some concern, but it was generally acknowledged that the TOAST test was going to be the least robust in the Astronomy 16 course.
Analysis SummaryShowing a gain verifies that instruction has a positive effect overall. However, there is still room for improvement. One of the issues is the TOAST test itself and another is the its alignment with the current SLOs of the course. Posttest scores above 12 out of 15 correct answers (80%) indicate outcome achievement.
Next Steps PlannedWe are revising the Course Outline of Record in Fall 2013.
Learning OutcomesALL

GE Area C Details

Learning OutcomesB. Visually identify a broad range of constellations, stars, nebulae, galaxies, planets, and other celestial objects.
Number Students: Proficient12
Number Students: DevelopingNo answer
Number Students: No EvidenceNo answer
CriteriaProficiency: Students score 70% or higher on a SLO-specific quiz containing multiple questions focusing on this model.

Developing: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model.

No Evidence: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model.
Extra DetailsOther SLO's on ASTR 16 that had data captured:

F. Analyze stellar spectra and classify stars according to their spectral features.

0, 0, 4

Tentative Future Plans

TermFall 2013
Activities

Revision of outcomes and assessment methods (measurements)

More DetailsCourse Outline Revision.

SLO Details Storage Location

ELECTRONIC COPY - In my electronic filing system (hard drive or web server)

Back to Department Overview