OATdb Archive

2010 - 2011

Biology BA

Goal
Deliver A Curriculum With Appropriate Discipline Specific Skill Sets
The curriculum will provide students with opportunities to develop the skills typically required of professionals in the area of study

Objective
Science And The Scientific Method
Students should have a general understanding of the nature of scientific knowledge and be able to apply the scientific method.

Indicator
MFT Analysis For BIO Majors
All graduating seniors are required to take the nationally standardized ETS Biology Major Field Test (MFT). Sections of the Biology MFT that correlate with an understanding of the scientific method and those that relate to understanding of the general nature of science are identified as programmatic assessments in these areas.

Criterion
MFT Analysis
All students are expected to score 50% or higher on the analytical skills indicators correlated with our foundational areas.

Finding
MFT Results
There were 53 graduating seniors who took the exam in May 2011.

The total score mean was at the 49% level compared to national numbers.

Indicator
CAT For Non-science Majors
CAT is a standardized exam for critical thinking. Student performance on this exam should increase following the completion of a non-science major course (BIO 134, 137, and 146). The department, in conjunction with the University QEP, is establishing protocol for the administration of this standardized test and collecting baseline data in select freshman courses.

Criterion
CAT For Non-science Majors
The CAT exam will be piloted in several sections of non-science major biology courses. Baseline data will be collected to establish a foundation for full implementation in subsequent years.  90% of students will score higher on the post-test than on the pre-test.

Finding
Critical Thinking
These results are for Fall 2010:

For BIO 137 Environmental Science, 80 students took the exam, 40 were pre-course, and 40 were post-course;  20 of these were randomly selected for scoring.  The mean pre-score was 17.1 +/- 4.6, and the mean post-score was 16.9 +/- 5.9.  Thus, there was no significant change in critical thinking skills for this course.

For BIO 134/146 Foundations of Science, 94 student exams were scored.  The mean pre-score was 15.5 +/- 5.6, and the mean post-score was 20.0 +/- 6.0. Thus, this course promoted a large improvement in critical thinking.

Action
Science And Scientific Method
We were not pleased with the results of our biology majors' achievement exam, despite the results being one percentage point away from the goal.  However, one major issue with the examination procedure is with student motivation.  The test therefore may not accurately reflect the student knowledge.  In discussions with others at a national science education conference (ASM-CUE), the Chair learned this is a rather common issue at institutions using a standardized exam.  The Department Assessment Committee is currently examining other instruments to assess the students, as the MFAT exam is copyright protected, and as a commercial product, has inherent limitations that do not allow us to modify it.  Costs of the MFAT prohibit the Department from using this exam as a pre-test and post-test in a statistically valid way.  Several faculty members will be attending teaching and learning conferences in the next semester which will include sessions on assessment and will bring back options to the Department.

A committee has been formed that will result in the development of several versions of our non-majors course most commonly taken by students (BIOL 1308 Contemporary Biology). These versions will incorporate teaching scientific menhtod and critical thinking, with many tools being imported form the successful Foundations of Science (FoS) course.  These courses will be assessed in the future for student learning outcomes, both in content and critical thinking skills, just as the FoS is now.  Several case studies have already been incorporated into the associated laboratory course (BIOL 1108).

Goal
Deliver A Curriculum With Appropriate Discipline Specific Knowledge
Students will have appropriate discipline specific knowledge.

Objective
Working Understanding Of Core Theories In Biology
Students should have a working understanding of core theories such as cell theory, the central dogma, and evolution.

Indicator
MFT Sections Related To Core Theories
Sections of the nationally standardized MFT exam related to the three core theories, cell biology, molecular biology, and population biology and evolution are identified as programmatic assessment of the biological core courses

Criterion
MFT Core Theory
All graduating BIO majors will score at least the national average in all three core areas assessed by the MFT.

Finding
MFT Core Results
There were 53 graduating seniors who took the exam in May 2011.

The mean score on the cell biology subsection was at the 45% level.

Action
Core Theories In Biology
Core Theories in Biology scores, particularly cell biology, did not meet the percentage we sought.  However, it falls within the standard deviation.  Thus, we need not apologize for our mean score; however, there is certainly room for improvement.  Our first course for majors related to these topics in BIOL 2440 Intro Cell Biology. This course now has a weekly three-hour recitation session added to it.  We will examine and develop the learning exercised in these recitations, and once the new building is completed, will have facilities to consider adding some wet lab activities as well.  

Goal
Deliver A Curriculum With Appropriate Core Field Knowledge
Students will have appropriate knowledge of core fields.

Objective
General Understanding Of Core Fields
Students should demonstrate familiarity with the following fields:
1) Botany- including plant morphology, taxonomy, genetics, physiology, and ecology
2)Zoology- including anatomy, behavior, physiology, ecology, and the systematic arrangement of the major animal taxonomy.
3) Cell biology- including macromolecules, metabolism, structure, and genetics.

Indicator
MFT Sections Related To Core Fields
Sections of the nationally standardized MFT exam related to the three core fields of botany, zoology, and cell biology are identified as assessments of knowledge in the core fields

Criterion
MFT Sections Related To Core Fields
All graduating BIO majors will score at least the national average in all three core fields assessed by the MFT.

Finding
MFT Core Fields Results
There were 53 graduating seniors who took the exam in May 2011.

The mean score on the organismal biology subsection was 42% level.
The mean score on the population biology, evolution, and ecology subsection was 42% level.


Action
MFT Core Fields In Biology
Our scores in organismal biology as well as population biology, evolution, and ecology were more disappointing but still within a standard deviation of the national mean.  In fact, nationally, the organismal biology scores tend to be lower nationally.  Nevertheless, our goal is to meet the national mean or even surpass it. Because there is a motivational issue related to the MFAT exam, thus preventing clear interpretation of the results, the faculty are discussing an expanded approach of using multiple assessment tools to evaluate our student understanding of core fields.  In our Biology Teaching and Learning meetings, we are now discussing the NSF-AAAS report, Vision and Change, on core concepts and key skills for undergraduate biology.  This national study will inform our efforts.


Update to previous cycle's plan for continuous improvement

Plan for continuous improvement We celebrate the success of critical thinking development in the Foundations of Science courses. We need to determine how we can duplicate this success in our remaining general education courses.  Although our percentages are within one standard deviation of the national average, our goal is to meet the national mean or exceed it.  Realizing the inherent limitations of using one standardized test to measure student content knowledge, we will also develop and employ more assessment tools.