Improving Critical Thinking And Analytic Reasoning
Students completing the critical thinking and logic courses in our curriculum will develop a broad-based skills in critical thinking and formal logic.
Objective
Demonstrate Critical Thinking Skills
Critical thinking skills are an essential component of philosophical work. Students will be able to analyze arguments and draw conclusions from available information.
Indicator
Response Scores On TACTS
All students who take PHIL 2303 will be tested on their critical thinking skills. All faculty who teach PHIL 2303 will administer the Texas Assessment of Critical Thinking Skill (TACTS)s, an externally validated test of critical thinking skills, in a pre-test/post-test format. The TACTS is a broad-based assessment of critical thinking skills that goes beyond the current scope of PHIL 2303. This will allow the faculty to determine areas that may be added to our current curriculum in the future. A copy of the current TACTS is attached. A copy of the credited responses is attached. The Philosophy Program Coordinator, currently Dr. Fair, will be responsible for ensuring that all faculty who teach PHIL 2303 effectively administer the pre- and post-tests in every section of their course. One faculty member, currently Dr. Sanford, will be responsible for gathering pre- and post-test data from the faculty members who teach PHL 2303.
Criterion
Statistically Significant Improvement From The TACTS Pre-test To The TACTS Post-test.
A paired two-sample t-test will be performed on the scores of all students who take the pre-test and the post-test. The philosophy program expects to see a statistically significant improvement from the pre-test to the post-test.
Finding
Significant Improvement From Pre-test To Post-test
A paired two-sample t-test on our sample of 471 student scores, for students who took both the pre-test and post-test, demonstrated a statistically significant improvement in their scores. Data and basic analysis are attached.
Criterion
Improvement In Calculating Probabilities
The data from the team that developed the TACTS show that a knowledge gap exists with respect to decision making when an outcome depends upon the conjunction of two probabilistic events. Their data show that less than 20% of those tested correctly answered the following question: "George is waiting for two of his customers, Fuzzy Logic Computers, Inc. and Stalking Horse Designs, to pay their bills. If either of them pays before the end of the month, then George can pay his supplier. But if neither of them pays, then George will have to take out a bank loan. George estimates that the chance that Fuzzy Logic will pay in time is 70% and the chance Stalking Horse Designs will pay in time is 60%. Assuming that his estimates are correct and that the two events are independent, what is the chance that George will have to take out a bank loan? (a) 12% (b) 40% (c) 65% (d) 42% (e) 88%"" 2011-2012 will be the third year that the Philosophy Program will expect all faculty to evaluate this type of reasoning as part of the critical thinking course. We will consider this initial effort successful if there is at least a 75% improvement on this type of question from the pre-test to the post-test.
Finding
Improvement In Calculating Probabilities
The sample is limited to only those students who took both the pre-test and post-test. For students whose pre-test score was reported, 81 out of 471 (17.2%) correctly answered the question. On the post-test, 183 out of 471 (38.9%) correctly answered the question. This represents a 126.2% improvement in the percentage of students who successfully answered the probability questions from the pre-test to the post-test and compares favorably to the 85.6% improvement seen in 2009-2010 and 106.5% seen in 2010-2011 yet, it remains a challenge to improve even further.
Action
Ongoing Improvement In Calculating Probabilities
Although our data showed a substantial improvement in calculating probabilities, it is expected that our faculty can improve on our third-year performance. All Philosophy Program faculty who taught PHIL 2303 during 2011-2012 will be invited to share their experiences with those who will teach PHIL 2303 during 2011-2012. In addition, input will be sought from other faculty who have experience teaching probability-based content. The goal will be to identify ways in which pedagogy in this area can be further improved without cutting back on the successful core of critical thinking skills we have regularly taught. It is expected that faculty will implement and evaluate new approaches during 2012-2013.
Goal
Understanding Of General Philosophical Concepts
Ensure that students acquire a general understanding of basic philosophical concepts.
Objective
Demonstrate Basic Understanding Of Core Concepts In Philosophy
As students progress through the Philosophy BA, they will acquire a basic understanding of metaphysics, epistemology, and moral theory. This basic information, provided by our introductory courses serves as the foundation for student success in upper-division courses.
Indicator
Statistically Significant Improvement Of Student Scores From Pre-test To Post-test (2361/2603)
All students in PHIL 2361 and PHIL 2603 will be tested on their knowledge of basic concepts in metaphysics, epistemology, and moral theory using a locally standardized pre-test and post-test for each course. Following a review of best practices for the teaching of these courses, a group of Program faculty chose the questions for the assessment. The questions asked cover the range of concepts that are taught in peer departments. Instruction on these concepts promotes a basic competence in metaphysics, epistemology, and moral theory. The attached documents provide the assessment instruments for PHIL 2361 and PHL 2603 as well as the credited responses for each.
Criterion
Statistically Significant Improvement From The Pre-test To The Post-test (2361/2603)
A paired two-sample t-test will be performed on the scores of all students who take the pre-test and the post-test. Students in both courses will demonstrate a statistically significant improvement from the pre-test to the post-test.
Finding
PHIL 2361 Pre-test/Post-test Results
PHL 2361 students demonstrated a statistically significant improvement from the pre-test (M=6.8) to the post-test (M=10.7). Although statistically significant, the post-test mean is only 53.5% with 20 items. See the attached data. This is consistent with the 51% during 2009-2010 and 54.5% during 2010-2011 on the post-test. Additional innovative strategies for teaching basic concepts in metaphysics, epistemology, and moral theory are needed to ensure deep learning.
Finding
PHIL 2603 Pre-test/Post-test Results
PHIL 2603 students demonstrated a statistically significant improvement from the pre-test (M=10.32) to the post-test (15.08). While statistically significant, the post-test mean is only 60.3% of 25 items. See the attached data. Hence, basic concepts in metaphysics, epistemology, and moral theory must be addressed in inventive ways so that deep learning versus shallow learning is accomplished.
Action
PHIL 2361/2603 Improvement
The Program will undertake a targeted instructional effort aimed at improving student learning. In PHIL 2603, this effort will focus on improving students' knowledge of arguments related to the death penalty. In PHIL 2361, it will focus on Kantian philosophy. These efforts will be evaluated via pre-test/post-test analysis on specific questions related to their respective content. Additionally, as the Program revises the PHIL 3364/3365 curriculum, we will do this with an eye toward identifying additional opportunities to improve the overall presentation of general philosophical concepts to our students.
Objective
Demonstrate Advanced Understanding Of History Of Philosophy
Well-educated philosophy students will demonstrate appreciation for the arguments and positions of earlier thinkers. Because so much of what is written in philosophy is a reaction to the metaphysical and epistemological presuppositions of earlier thinking, it is the core of well-rounded philosophical education.
Indicator
Pre-test Post-test Response Scores On Locally-Standardized Instruments (364/365)
All students in PHL 364 and PHL 365 will be tested on their knowledge of general concepts in the history of philosophy. All faculty who teach these courses will administer a pre-test and post-test to all students. All Philosophy BA students are required to take PHL 364 (Ancient and Medieval Philosophy) and PHL 365 (Modern Philosophy). Together, these courses provide students with upper-level instruction covering the history of metaphysics and epistemology. Following a review of best practices for the teaching of these courses, a group of Program faculty chose the questions for the assessment. The questions cover the range of concepts that are taught in peer departments. Instruction on these concepts promotes a well-rounded understanding of the history of philosophy.
Criterion
PHL 365 Assessment
A paired two-sample t-test will be performed on the scores of all students who take the pre-test and the post-test. Students in both courses will demonstrate a statistically significant improvement from the pre-test to the post-test. In addition, at least 70% of students will correctly answer 70% of the questions on the post-test.
Finding
PHIL 3365
The data reported by the faculty member who taught the only section of PHIL 3365 did not reflect the expected assessment of the course. The assessment coordinator is unable to report meaningful findings or draw conclusions from the data. Dr. Sanford acknowledged receipt of the spreadsheet containing the data without realizing that deficiency. By the time he recognized the problem, recovery of the data had become impractical.
Criterion
PHL 364 Assessment
A paired two-sample t-test will be performed on the scores of all students who take the pre-test and the post-test. Students in both courses will demonstrate a statistically significant improvement from the pre-test to the post-test. In addition, at least 70% of students will correctly answer 70% of the questions on the post-test.
Finding
PHIL 3364 Data
Students demonstrated a statistically significant improvement from the pre-test (M=0.18) to the post-test (M=6.73). Although statistically significant, post-test mean is only 35.4% with 19 items. This still represents a weakness in teaching the history of metaphysics and epistemology in modern philosophy
Action
PHIL 3364/3365 Improvement
The Program will focus on improving deep learning by looking for ways to improve the links between PHL 2361/2603 and PHL 3364/3365. The goal will be to provide greater continuity between the introductory and advanced courses with an eye toward improving students' long-term outcomes as they proceed through the Program's curriculum. Year-over-year data for PHIL 3364/3365 has not indicated the desired level of student achievement. For 2012-2013, the Program will undertake a thorough revision of PHIL 3364/3365. This revision will include a ground-up reconsideration of the texts used, pedagogical methods, and overall course design for both of the advanced history of philosophy courses.