OATdb Archive

2012 - 2013

English BA

Goal
Secondary English Education Certification
English majors and minors seeking certification as Secondary English teachers will receive a grounding in literature, in writing, and in the pedagogy of Secondary English.

Objective
Secondary English Certification Validation
Students seeking teacher certification will demonstrate knowledge and skills to teach English to secondary students. Our objective is, first, to produce highly competent secondary English language arts and reading teachers to be certified by the Texas Education Agency to teach in Texas high schools.  Our curriculum and oversight of ELAR certification is designed with that objective, as opposed to a focus on test scores alone.  We believe that if our courses and other preparations are solidly grounded in excellent practices (that have been appropriately aligned with state standards, the test results will take care of themselves.  However, we do provide careful oversight and counseling of our certification students, as well as thorough (and thoroughly aligned) preparation workshops.  Our objective, then, is well-prepared students who also perform at high passing rates on the state certification exam.

Indicator
English TExES
Secondary English Education students will be prepared to pass the TExES English content area exam in their final semester or shortly after graduating. The State Board for Educator Certification (SBEC) developed standards for Texas educators that delineate what the beginning educator should know and be able to do. These standards, which are based on the state-required curriculum for students, the Texas Essential Knowledge and Skills (TEKS), form the basis for the Texas Examinations of Educator Standards (TExES).  The TExES test is a criterion-referenced examination designed to measure the knowledge and skills required in English language and literature teaching. A score of 240 is the minimum level of competency required over all of the domains. A student may fail a domain but pass the test. The following are the areas tested: Domain I: Integrated Language Arts, Diverse Learners, and the Study of English; Domain II: Literature, Reading Processes, and Skills for Reading Literary and Nonliterary Texts; Domain III: Written Communication; Domain IV: Oral Communication and Media Literacy.    

The measurement of our preparation (at least on the test-taking side) is performance on the Texas Examination for Certification Standards (TExES).  (The particular examination for secondary English is Field 131—8-12 English Language Arts and Reading.)  Last year, we indicated a desired passing rate of 75%, which we far exceeded.  The fact is, we are confident that our passing rates should and will be significantly higher.  The standard we are seeking to reach now is 90% passing rates for the secondary English certification students who take the exam. 

Criterion
TExES Scores
At least 75 percent of students taking the TExES English content area exam will obtain passing scores in each domain. Although last year, 100 percent of students who took the test passed, two areas emerged as weaknesses, II. Literature, Reading Processes, and Skills for Reading Literary and Nonliterary Texts; and III. Written Communication. We are anxious to determine if our interventions have been successful in raising these particular scores.

Finding
Certification Exam
Goal: Producing High Rates of Certification Exam Passing Results 

During 2012-13, twenty-one secondary English certification majors took the 8-12 ELAR TExES during the 2012-13 assessment period.  (Actually 25 certification testers took the exam, but four of them—including one of the failures—were students from the graduate Curriculum and Instruction program in the College of Education (and thus are not “our” students.)   There were actually twenty-two test attempts, but since one of our students failed the test and then retook it, and passed, there twenty-one students tested.  Twenty of the twenty-one instances resulted in passing scores, for an overall passing rate of 95.45%, exceeding the objective of 90%.  All twenty-one of our test takers individual students passed the exam during the assessment period, for an effective passing rate of 100%. 

For 2011-12, our identified strengths were in Domain II (Literature, Reading Processes, and Skills for Reading Literary and Nonliterary Texts) and Domain III (Written Communication).  While our students’ overall results in these domains brought us into successful territory, their scores fell off alarmingly in Domain I (Integrated Language Arts, Diverse Learners, and the Study of English).  During the year, we concentrated on enhanced instruction in this area, and for 2012-13, the Domain I results rose to be in accord with the high performance in the other domains.


Action
Curricular Excellence In 2013-14
Action: With the substantial improvements in our only identified area of weakness (Domain I: Integrated Language Arts, Diverse Learners, and the Study of English), we have no real identified weakness as indicated by our students’ performance on the state certification examination. Our action is to continue our curricular and preparation initiatives to ensure a continuation of this excellent performance.

Goal
Literature And Literary Theory (4000-level)
Students majoring in English will acquire an appreciation of various critical approaches and methodologies in studying literature and literary theory.

Objective
Reading Literature Critically And Writing About It Analytically
Students will be able to use various approaches and methodologies presented in analyzing literary texts and demonstrate the ability to interpret texts by communicating their understanding of those texts in analytic essays.

Indicator
Writing Assessment
Reading and writing are part and parcel of each other. Essays written to analyze and/or apply literary texts suggest the depth and quality of the students' reading, as well as their understanding of the assignment. Thus, during spring semester, we will collect writing samples of English majors from 4000-level (senior-level) classes and examine them to ascertain the effectiveness of reading that they evince. Our goal is to read 25 percent of the essays, chosen at random, written by English majors in 4000-level literature courses. We anticipate an enrollment of some 105 students in any given long semester and so should expect to read 26 to 30 essays. Two experienced English professors agree that 70 percent of the students write at college level. College-level writing is defined as fluent, coherent, nearly error-free writing. For the purpose of evaluation, clear criteria were developed (see attachment).


Criterion
Score Of Five Or Greater On An Eight-Point Scale
The chosen essays will be assessed by a primary trait scoring done by Department of English faculty. The traits to be assessed will include plot summary vs. analysis and effective use of secondary sources. A score equal to or greater than 5 will be deemed acceptable. One weakness evident last year was that we did not receive enough essays for the results to be meaningful and reliable. (We received only fifteen essays.) We will rectify that weakness this year. Seventy percent of the sample of collected 4000-level essays satisfies the requirements of mature academic BA-level writing as assessed holistically by two scoring professors. Students write fluent, coherent, and nearly error-free analytical essays which show sophistication in literary analysis that goes beyond mere superficial plot summaries, and their essays have a point (see attached evaluation criteria). We were concerned last year with whether our process was reliable. We are taking steps to ensure reliability of the process. 

 


Finding
Focus On Analyzing 2000-level Writing
Intentionally, there is no finding of 4000-level writing this year. This year, our decided goal was to focus on analyzing 2000-level, as 4000-level writing had been quite adequate the previous year.

Action
Collecting Essays In The Spring 2014 From Seniors
Next year, we will resume to collect essays from our 4000-level writers to evaluate whether their writing has started to reflect more the changes we have made into the English sophomore curriculum. In a couple of years, these effects should start to show in the seniors' writing skills.

Goal
Gaining Knowledge In World And Multicultural Literature (2000-level)
Students majoring in English will be able to employ a variety of writing styles so that they may succeed in professional situations and/or as teachers.

Objective
Understanding Literary Terms And Having A Basic Knowledge Of Major Writers
Students will demonstrate understanding of basic literary terms and a basic knowledge of important writers.


Indicator
Literary Terms And Periods
During Fall 2011, an objective test for the core English sophomore course was developed by professors who teach World Literature II (ENGL 2342). Seventy percent of sophomores are expected to pass the posttest with 70 percent correct answers. Comparing the pretest, given in the beginning of the semester, to the posttest in May will indicate whether any learning took place or not.


Criterion
Quantified Success In Analytic Writing
Seventy percent of the sample of 2000-level posttest results will show that students have necessary rudimentary knowledge (score of 70 percent or higher) of literature after having taken a sophomore World Literature course. This basic knowledge is necessary before continuing to junior- and senior-level English classes.


Finding
Students Have Only Rudimentary Knowledge Of Literature
50% of the tested sophomores failed the Sophomore Assessment Instrument for ENGL 2342.


Action
Consciousness Raising Of The Results
Action: Faculty will brainstorm how to improve the results.

Objective
Gaining Knowledge In World And Multicultural Literature
2000-level students are able to write about literature.

Indicator
Seventy Percent Of Sophomore Writers Are Deemed Acceptable Writers
Two English professors assess 70 percent of ENGL 2331 essays as acceptable. This assessment is done through blind review. Acceptable is defined as a score 5 on an scale 2-8. See the attached grading criteria.

Criterion
Under 30 Percent Unacceptable
Only 30 percent or fewer of the essays are classified as not fulfilling requirements for acceptable academic writing. 

Finding
61-percent Passing Rate
Only 61 percent of our sophomores are assessed to write acceptably for their level.


Action
Faculty Meeting To Discuss The Results
In the fall 2013 faculty meeting, these results will be discussed to raise consciousness of the fact that there still is work to do even though some improvement has taken place. This discussion must take place before any more concrete action can take place, i.e., this consciousness raising is the first action step. Faculty teaching sophomore English will implement a rigorous regimen of (1) teaching literary terms and (2) teaching explicitly how to write an effective essay about literature.

Update to previous cycle's plan for continuous improvement

Last year (2011-12), a comparison between English sophomore and senior writing was carried out, with the purpose of evaluating whether senior-level writing is better than sophomore-level writing, i.e., whether students have learned to write better while in the English program. We found that, indeed, 66 percent of English seniors write at passing level (as determined via our department-internal criteria), while only 50 percent of sophomores do.

For the academic year 2012-13, we focused on evaluating our sophomore writers, of whom only 50 percent had passed our departmental criteria. In the spring of 2013, an electronic mail was sent to all English faculty teaching sophomore courses, with instructions to collect the last substantial essay assignment from every fifth student for evaluation purposes. Altogether 57 essays were collected from all sophomore English sections. This represented some 20 percent of students in all sophomore classes. In May, full faculty, adjuncts, and teaching assistants (some 30 people) gathered to evaluate the essays. Instructions to evaluators are attached. See Table 1 for improvement:


































































Score



Spring 2012



Spring 2013 (N=57)



2



19%



  5%



3



14%



18%



4



17%



16%



5



21%



25%



6



17%



19%



7



 7%



14%



8



 5%



  4%



 



100%



101%


 



 



Spring


2012



Spring 2013



Failing (2-4)



50%



39%



Passing


(5-8



50%



62%



 


Table 1. Comparison between score results in 2012 and 2013.


We found that only within one year, a jump from 50-percent acceptance rate to a 62-percent acceptance rate had taken place. We attribute this to consciousness-raising of what sophomore writing should consist of. Also, the new sophomore curriculum can be credited for higher writing ability. Inter-reader reliability was very high; only three essays required a third reader (tie-breaker).


There was, however, a discrepancy between scores between the two sophomore courses, ENGL 2331 (World Literature I: Before the Seventeenth Century) and ENGL 2342 (World Literature II: Seventeenth Century and After) (see Table 2):




















































































Score


 



ENGL 2331


(N=35)


N     



ENGL 2342


(N=22)


N     



Total


(N=57)


N     



2



2



1



 3



3



4



6



10



4



7



2



  9



5



7



7



14



6



8



3



11



7



5



3



  8



8



2



0



  2



 



 



 



 



 



%    N



 %  N



 %  N



Failing


(2-4)



37   (13)



41   (9)



 39  (22)



Passing


(5-8)



63   (22)



59  (14)



 61  (35)



 



100 (35)



100 (23)



 100 (57)




Table 1. Comparison of writing scores between ENGL 2331 and ENGL 2342 students.


It is interesting to note that while 63 percent of World Literature I (ENGL 2331) students write in a passable manner, only 59 percent of World Literature II (ENGL 2342) students do. We hope to follow up with this in the next year or the following one, to see if this is a coincidence or whether we are witnessing a tre 

Last year (2011-12), a comparison between English sophomore and senior writing was carried out, with the purpose of evaluating whether senior-level writing is better than sophomore-level writing, i.e., whether students have learned to write better while in the English program. We found that, indeed, 66 percent of English seniors write at passing level (as determined via our department-internal criteria), while only 50 percent of sophomores do.

For the academic year 2012-13, we focused on evaluating our sophomore writers, of whom only 50 percent had passed our departmental criteria. In the spring of 2013, an electronic mail was sent to all English faculty teaching sophomore courses, with instructions to collect the last substantial essay assignment from every fifth student for evaluation purposes. Altogether 57 essays were collected from all sophomore English sections. This represented some 20 percent of students in all sophomore classes. In May, full faculty, adjuncts, and teaching assistants (some 30 people) gathered to evaluate the essays. Instructions to evaluators are attached. See Table 1 for improvement:


































































Score



Spring 2012



Spring 2013 (N=57)



2



19%



  5%



3



14%



18%



4



17%



16%



5



21%



25%



6



17%



19%



7



 7%



14%



8



 5%



  4%



 



100%



101%


 



 



Spring


2012



Spring 2013



Failing (2-4)



50%



39%



Passing


(5-8



50%



62%



 


Table 1. Comparison between score results in 2012 and 2013.


We found that only within one year, a jump from 50-percent acceptance rate to a 62-percent acceptance rate had taken place. We attribute this to consciousness-raising of what sophomore writing should consist of. Also, the new sophomore curriculum can be credited for higher writing ability. Inter-reader reliability was very high; only three essays required a third reader (tie-breaker).


There was, however, a discrepancy between scores between the two sophomore courses, ENGL 2331 (World Literature I: Before the Seventeenth Century) and ENGL 2342 (World Literature II: Seventeenth Century and After) (see Table 2):




















































































Score


 



ENGL 2331


(N=35)


N     



ENGL 2342


(N=22)


N     



Total


(N=57)


N     



2



2



1



 3



3



4



6



10



4



7



2



  9



5



7



7



14



6



8



3



11



7



5



3



  8



8



2



0



  2



 



 



 



 



 



%    N



 %  N



 %  N



Failing


(2-4)



37   (13)



41   (9)



 39  (22)



Passing


(5-8)



63   (22)



59  (14)



 61  (35)



 



100 (35)



100 (23)



 100 (57)




Table 1. Comparison of writing scores between ENGL 2331 and ENGL 2342 students.


It is interesting to note that while 63 percent of World Literature I (ENGL 2331) students write in a passable manner, only 59 percent of World Literature II (ENGL 2342) students do. We hope to follow up with this in the next year or the following one, to see if this is a coincidence or whether we are witnessing a trend.
Plan for continuous improvement Next year or the following year we will compare the results of ENGL 2331 and ENGL 2342 again, to see if we are looking at a trend or whether this year's discrepancy in results was a coincidence. All professors will be made aware of the results, and they will emphasize overall excellence to all students. It may be that students self-select to these two core courses, more diligent ones choosing ENGL 2331 (World Literature I: Before Seventeenth Century). This means that ENGL 2342 must be made aware that the expectation are the same for these two courses, despite the difference in the chronology of reading materials.

Sam Houston State University | A Member of The Texas State University System