ESL 140 - High-Intermediate Academic ESL - Stage 5 - Keech

Assessment

Assessment Methods

Analysis of exam, quiz, or homework items linked to specific SLOs

Assessment DescriptionCommon final exam in Reading and Grammar
Learning OutcomesA. Reading

a. Demonstrate comprehension of a variety of authentic texts in a variety of genres of limited conceptual and/or linguistic complexity

b. Show comprehension in independent and extensive reading tasks

c. Demonstrate a continued increasing ability to read critically to recognize and evaluate concepts, viewpoints, and methods of presentation

d. Demonstrate the ability to read with increasing speed and efficiency as a result of applying previously-acquired (in ESL 120 and 130) reading

strategies

e. Demonstrate a continued ability to read closely for textual clues to meaning

C. Grammar

a. Demonstrate comprehension and production of a wide variety of noun

phrases and clauses

b. Demonstrate comprehension and production of the English verb system at a

high-intermediate level

c. Demonstrate comprehension and production of a variety of compound and complex sentences, including unreal conditionals and parallel series
Number of Sections15
Number of Instructors15
Number of Students375

Data Analysis

Data Shared With
  • Instructors of the same course (at CCSF)
  • Faculty and staff within our department
Data Sharing Methods

Face-to-face meetings

Data SummaryTest Statistics: Overall

Statistic Value

Number of Tests Graded 359

Number of Graded Items 80

Total Points Possible 80.00

Maximum Score 71.00

Minimum Score 20.00

Median Score 48.00

Range of Scores 51.00

Percentile (25) 41.00

Percentile (75) 55.00

Inter Quartile Range 14.00

Mean Score 47.49

Variance 92.36

Standard Deviation 9.61

Confidence Interval (1%) 46.19

Confidence Interval (5%) 46.50

Confidence Interval (95%) 48.49

Confidence Interval (99%) 48.80

Kuder-Richardson Formula 20 0.82

Coefficient (Cronbach) Alpha 0.82

Mean Percent Score 59.37

Test Statistics: READING

Statistic Value

Number of Tests Graded 359

Number of Graded Items 30

Total Points Possible 30.00

Maximum Score 27.00

Minimum Score 7.00

Median Score 17.00

Range of Scores 20.00

Percentile (25) 15.00

Percentile (75) 20.00

Inter Quartile Range 5.00

Mean Score 17.50

Variance 16.17

Standard Deviation 4.02

Confidence Interval (1%) 16.95

Confidence Interval (5%) 17.08

Confidence Interval (95%) 17.91

Confidence Interval (99%) 18.05

Kuder-Richardson Formula 20 0.61

Coefficient (Cronbach) Alpha 0.61

Mean Percent Score 58.33

Test Statistics: GRAMMAR

Statistic Value

Number of Tests Graded 359

Number of Graded Items 50

Total Points Possible 50.00

Maximum Score 48.00

Minimum Score 8.00

Median Score 31.00

Range of Scores 40.00

Percentile (25) 25.00

Percentile (75) 36.00

Inter Quartile Range 11.00

Mean Score 29.99

Variance 52.74

Standard Deviation 7.26

Confidence Interval (1%) 29.01

Confidence Interval (5%) 29.24

Confidence Interval (95%) 30.75

Confidence Interval (99%) 30.98

Kuder-Richardson Formula 20 0.81

Coefficient (Cronbach) Alpha 0.81

Mean Percent Score 59.99
Analysis SummaryCCSF Credit ESL Program

Spring 2013 Report on Final Examinations (Reflecting on Student Learning Outcomes)

Laura Walsh, Credit ESL SLO Coordinator

ESL 140 Grammar

This test is functioning well, with a reliability index of .81 and a mean score of 29.99/50. Scores range from 8 to 48, with a number of students scoring high. Item quality is also high on this test, with a large percentage of items with high point biserials.

High-quality items with less than 50% success rate include

• Reduced relative clauses: “We didn’t know whom to ask.” 47% of students answered “We didn’t know who should we ask.”

• Relative clauses with where: Both items that tested this revealed weakness, e.g., “I enjoy living in San Francisco, where has many different cultures.” ESL students are often under the mistaken impression that any relative clause following a location should begin with where.

• Relative clauses with prepositions

• Unreal conditionals: The majority of ESL 140 students are not able to match up both clauses in unreal conditional sentences.

• Parallelism in comparisons: It’s better to blank than to blank/blanking.

• Comma splices with however

• Pronoun reference with people and you (may reflect speech patterns)

• Count nouns

• Finally, even our best ESL 140 students seem to believe that aware is a verb.

ESL 140 Reading

This test has one reading that proves to be difficult even for the good students and needs to be replaced. Overall, the mean score is acceptable, 17.5/30 and the range of scores is good, 7 through 27.

The students’ problems seem to focus on two areas:

• In several items, this test asks students to select the correct paraphrase of a line or phrase from the text. Students are selecting paraphrases that might appear to be correct if the student hadn’t read the text. Perhaps students could practice summary/paraphrase more as a means of demonstrating reading comprehension?

• Students are unable to determine the meaning of a lexical item from context even when a synonym is available in the surrounding text. Possibilities: 1) we don’t practice this enough or 2) this isn’t an effective reading strategy for most ESL 140 students.
Next Steps PlannedNo answer
Learning OutcomesNo answer

Changes

DetailsCourse outline revised, approved by College Curriculum Committee in March 2013
Learning OutcomesALL

Tentative Future Plans

TermSpring 2014
Activities
  • Assessment (measurement) of outcomes
  • Analysis and discussion of assessment data and next steps
  • Implementation of planned changes and reassessment
More DetailsCommon final in Reading and Grammar results will be reported and discussed in ESL Credit Curriculum Committee.

Revised course outline implemented.

SLO Details Storage Location

HARD COPY - In a department filing system (department office)

Back to Department Overview