ASTR 16 - Observational Astronomy - Stage 5 - Todd Rigg Carriero
Assessment
Assessment Methods | Pre & post surveys or tests |
---|---|
Assessment Description | TOAST is used as an assessment tool of Course-Level Student Learning Outcomes (SLOs). The Test Of Astronomy STandards (TOAST) Assessment Instrument underwent iterative development, showing that it has a high degree of reliability and validity. This multiple-choice test is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. TOAST can help measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community. |
Learning Outcomes | ALL |
Number of Sections | 3 |
Number of Instructors | 2 |
Number of Students | ~15 |
Data Analysis
Data Shared With |
|
---|---|
Data Sharing Methods | Face-to-face meetings |
Data Summary | On average across 1 of 3 sections, the students answered correctly 10 out of 15 questions on the TOAST pre-test and 9 out of 15 on the posttest. Two questions consistently chosen incorrectly on pre- and posttest showed minor improvement, but the prime distracter in each case showed a minor increase as well. One, based upon Wein’s Law, and the other based upon the causes of the seasons. The negative gain is of some concern, but it was generally acknowledged that the TOAST test was going to be the least robust in the Astronomy 16 course. |
Analysis Summary | Showing a gain verifies that instruction has a positive effect overall. However, there is still room for improvement. One of the issues is the TOAST test itself and another is the its alignment with the current SLOs of the course. Posttest scores above 12 out of 15 correct answers (80%) indicate outcome achievement. |
Next Steps Planned | We are revising the Course Outline of Record in Fall 2013. |
Learning Outcomes | ALL |
GE Area C Details
Learning Outcomes | B. Visually identify a broad range of constellations, stars, nebulae, galaxies, planets, and other celestial objects. |
---|---|
Number Students: Proficient | 12 |
Number Students: Developing | No answer |
Number Students: No Evidence | No answer |
Criteria | Proficiency: Students score 70% or higher on a SLO-specific quiz containing multiple questions focusing on this model. Developing: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model. No Evidence: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model. |
Extra Details | Other SLO's on ASTR 16 that had data captured: F. Analyze stellar spectra and classify stars according to their spectral features. 0, 0, 4 |
Tentative Future Plans
Term | Fall 2013 |
---|---|
Activities | Revision of outcomes and assessment methods (measurements) |
More Details | Course Outline Revision. |
SLO Details Storage Location
ELECTRONIC COPY - In my electronic filing system (hard drive or web server)