ASTR 1 - Cosmic Evolution - Stage 5 - Todd Rigg Carriero
Assessment
| Assessment Methods | Pre & post surveys or tests |
|---|---|
| Assessment Description | TOAST is used as an assessment tool of Course-Level Student Learning Outcomes (SLOs). The Test Of Astronomy STandards (TOAST) Assessment Instrument underwent iterative development, showing that it has a high degree of reliability and validity. This multiple-choice test is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. TOAST can help measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community. |
| Learning Outcomes | ALL |
| Number of Sections | 5 |
| Number of Instructors | 3 |
| Number of Students | ~210 |
Data Analysis
| Data Shared With |
|
|---|---|
| Data Sharing Methods | Face-to-face meetings |
| Data Summary | On average across 5 sections, the students answered correctly 7.2 out of 15 questions on the TOAST pre-test and 10.4 out of 15 on the posttest. Two questions consistently chosen incorrectly on pre- and posttest showed minor improvement, but the prime distracter in each case showed a minor increase as well. One, based upon Wein’s Law, and the other based upon the causes of the seasons. |
| Analysis Summary | Showing a gain verifies that instruction has a positive effect overall. However, there is still room for improvement. One of the issues is the TOAST test itself and another is the its alignment with the current SLOs of the course. Posttest scores above 12 out of 15 correct answers (80%) indicate outcome achievement. |
| Next Steps Planned | Our plan is to improve the testing tool to better align with the Course Outline of Record's Learning Outcomes. |
| Learning Outcomes | No answer |
GE Area C Details
| Learning Outcomes | D. Distinguish the roles and interactions of fundamental particles, forces, and astrophysical processes in the universe. |
|---|---|
| Number Students: Proficient | No answer |
| Number Students: Developing | 87 |
| Number Students: No Evidence | No answer |
| Criteria | Proficiency: Students score 70% or higher on a SLO-specific quiz containing multiple questions focusing on this model. Developing: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model. No Evidence: Students score 30-70% on a SLO-specific quiz containing multiple questions focusing on this model. |
| Extra Details | Other SLO's on ASTR 1 that had data captured: F. Differentiate the major properties of astronomical objects: clusters of galaxies, galaxies, stars and stellar remnants, planetary systems. 123, 23, 0 G. Assess models of the formation, evolution, and interactions of galaxies and of stars. 0, 98, 0 I. Interpret and analyze astrophysical theories and data on cosmological, galactic, stellar, and planetary levels. 134, 25, 0 |
Tentative Future Plans
| Term | Fall 2013 |
|---|---|
| Activities | Revision of outcomes and assessment methods (measurements) |
| More Details | Revise testing tool to better align with Learning Outcomes. |
SLO Details Storage Location
ELECTRONIC COPY - In my electronic filing system (hard drive or web server)