ASTR 17 - Solar System - Stage 5 - Todd Rigg Carriero
Assessment
| Assessment Methods | Pre & post surveys or tests |
|---|---|
| Assessment Description | TOAST is used as an assessment tool of Course-Level Student Learning Outcomes (SLOs). The Test Of Astronomy STandards (TOAST) Assessment Instrument underwent iterative development, showing that it has a high degree of reliability and validity. This multiple-choice test is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. TOAST can help measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community. |
| Learning Outcomes | ALL |
| Number of Sections | 1 |
| Number of Instructors | 1 |
| Number of Students | ~30 |
Data Analysis
| Data Shared With |
|
|---|---|
| Data Sharing Methods | Face-to-face meetings |
| Data Summary | In the 1 section, the students answered correctly 10 out of 15 questions on the TOAST pre-test and 11 out of 15 on the posttest. Two questions consistently chosen incorrectly on pre- and posttest showed minor improvement, but the prime distracter in each case showed a minor increase as well. One, based upon Wein’s Law, and the other based upon the causes of the seasons. The minor gain is of some concern, but it was generally acknowledged that the TOAST test included very few questions that are specifically addressed in Astronomy 17. |
| Analysis Summary | Showing a gain verifies that instruction has a positive effect overall. However, there is still room for improvement. One of the issues is the TOAST test itself and another is the its alignment with the current SLOs of the course. Posttest scores above 12 out of 15 correct answers (80%) indicate outcome achievement. |
| Next Steps Planned | Our plan is to improve the testing tool to better align with the Course Outline of Record's Learning Outcomes. |
| Learning Outcomes | ALL |
GE Area C Details
| Learning Outcomes | C. Outline major theories of the origin and evolution of the Sun and its family of planets. |
|---|---|
| Number Students: Proficient | No answer |
| Number Students: Developing | 20 |
| Number Students: No Evidence | No answer |
| Criteria | Proficiency: Students score 70% or higher on a SLO-specific quiz containing multiple questions focusing on this model. Developing: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model. No Evidence: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model. |
| Extra Details | No answer |
Tentative Future Plans
| Term | Fall 2013 |
|---|---|
| Activities | Revision of outcomes and assessment methods (measurements) |
| More Details | Revise testing tool to better align with Learning Outcomes. |
SLO Details Storage Location
ELECTRONIC COPY - In my electronic filing system (hard drive or web server)