OATdb Archive

2010 - 2011

Management Information Systems BBA

Goal
Management Information Systems- A Broad Base Of Knowledge
The goal of the BBA program in Management Information Systems is to provide students with a broad base of knowledge in the Management Information System discipline. 291,388,379,390,431,485.

Objective
Information Systems
Students who complete the BBA in Management Information Systems will demonstrate an understanding of basic computer technology concepts and the development and use of information systems in organizations. 388

Indicator
Information Systems Pre-Test And Post-Test
Assessment will be made using pre-test and post- test performance on computer technology and the role of information systems in organizations.388

Criterion
Information Systems: Improvement On Post-Test Scores
The target class average on post-test questions will be 75% correct.388

Finding
Information Systems Finding
This objective was not assessed in 2010-2011 but is scheduled for assessment at a later time.

Action
MIS 388
This objective is scheduled to be assessed during the Spring 2012 semester . All faculty scheduled to conduct assessments must meet with the assessment coordinator and department chair prior to the beginning of the semester to review objectives, criterion, and indicators.


Objective
Programming
Students who complete the BBA in Management Information Systems will demonstrate the ability to analyze and define business problems from a programming perspective and an understanding of the basic concepts of programming, problem solving, and program logic. 291

Indicator
Programming Pre-Test, Post-Test, And Rubric
Assume that students have little or no prior knowledge of the topics; assessment will be made using three examinations to evaluate both the understanding of fundamental concepts of the three programming paradigms (procedural, object-oriented, and event-driven) and the ability to apply them to solve business problems. Common multiple-choice questions will be used to assess the understanding, while coding problems will be used to assess the ability to apply. 291


Criterion
Programming: Improvement On Post-Test And Rubric Scores
The average across class sections on each exam will be 75% correct. The class average on the section testing the understanding of fundamental concepts of both procedural and object-oriented paradigms will be 75% correct. Also, the class average on the section testing the ability to apply the concepts of concepts of both procedural and object-oriented paradigms will be 75% correct. The class average on the exam on event-driven paradigm will be 75% correct; this last exam contains one coding problem, combining the understanding and application. 291


Finding
Programming Findings
For procedural paradigm exam, the overall class average falls below the criterion (71.5%). While the class average on the section testing the understanding exceeds the criterion (86.1%), the class average on the section testing the ability to apply falls below the criterion (58.9%). For object-oriented paradigm exam, the overall class average exceeds the criterion (79.3%). Both the class average on the section testing the understanding (80.4%) and the class average on the section testing the ability to apply (78.3%) exceed the criterion. For event-driven paradigm exam, the overall class average exceeds the criterion (87.8%). 291


Action
MIS 291
Of the three paradigms, procedural appears to be most challenging to the students, as both the overall class average on the exam (71.5%) and the class average on the ability to apply procedural programming concepts and techniques (58.9%) do not meet the criterion. Nonetheless, this is expected, as, assuming students have little or no prior knowledge, this is the first paradigm covered in the course, so it requires a rather steep learning curve. In the future, either more time or more in-class demos, or both, will be provided. In addition, as all the coding problems are tied to the quizzes and homework not only heavily but also in intended sequences, due dates on homework submission can be more strongly enforced. 291



Objective
Systems Analysis And Design
Students who complete the BBA in Management Information Systems will demonstrate an understanding of the design and application of information systems in business and a knowledge of the tools and processes used in systems analysis and design. 379

Indicator
Systems Analysis And Design Pre-Test, Post-Test, And Rubric
Assessment will be made using pre-test and post-test performance on the design and application of information systems and the tools and processes used to achieve such designs. A rubric will be used to assess skills in systems analysis and design.379

Criterion
Systems Analysis And Design: Improvement On Post-Test And Rubric Scores
Students will average at least a 50% improvement over the pre-test. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. Seventy five percent of Management Information Systems majors will receive a score of at least acceptable on the Management Information Systems rubric. 379

Finding
Systems Analysis And Design
This objective was not assessed in 2010-2011 but is scheduled for assessment at a later time.

Action
MIS 379
This objective is scheduled to be assessed during the fall 2012 semester. All faculty scheduled to conduct assessments must meet with the assessment coordinator and department chair prior to the beginning of the semester to review objectives, criterion, and indicators.


Objective
Database
Students who complete the BBA in Management Information Systems will demonstrate an understanding of the design and implementation of database applications and how database software works and its inclusion in design solutions. 390

Indicator
Database Pre-Test, Post-Test, And Rubric
Assessment will be made using post-test performance on design and implementation of database applications and how database software works.  The first two tests also include problems that will reflect performance on two specific learning objectives, specifically design and SQL programming. 390

Criterion
Database: Improvement On Post-Test And Rubric Scores
Students are assumed to have no previous knowledge of database design and implementation skills and are not given a pretest. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. In addition, there are two problems in the first two tests and students should score at least 75% on them. 390

Finding
Database: Findings
The overall posttest scores for questions on all three exams were at or above the criteria (75, 83, 77).  Answers for the two problems had mixed results.  The problem covering design averaged 75 but the SQL problem was a 54. Analyzing the SQL scores of those students who did the SQL homework versus those that did not showed that the ones who did the homework averaged 72 and those who did not do the homework had a 36 average. 

Action
MIS 390
We will consider increasing the value of the SQL homework to encourage more students to do it and share the statistics cited above with them.


Objective
Electronic Commerce
Students who complete the BBA in Management Information Systems will demonstrate the ability to implement business oriented systems for electronic commerce and skills in using Internet technologies. 431

Indicator
Electronic Commerce Pre-Test And Post-Test
Assessment will be made using pre-test and post-test performance on business oriented systems.431

Criterion
Electronic Commerce: Improvement On Post-Test Scores
Students will average at least a 50% improvement over the pre-test. The class average on individual post-test questions will be 75% correct. Post-test questions will be included on each unit examination. 431

Finding
Electronic Commerce Finding
This objective was not assessed in 2010-2011 but is scheduled for assessment at a later time.

Action
MIS 431
This objective is scheduled to be assessed during the Spring 2012 semester . All faculty scheduled to conduct assessments must meet with the assessment coordinator and department chair prior to the beginning of the semester to review objectives, criterion, and indicators.


Objective
Networking
Students who complete the BBA in Management Information Systems will demonstrate an understanding of telecommunications services and networking technologies and skills in installing and managing networks within business organizations. 485


Indicator
Tests And Networking Project
Assessment will be made using test performance on understanding of telecommunications services and networking technologies. A project will be used to assess skills in working as a team to install and manage a network. 485


Criterion
Tests And Networking Project
The class average on individual test questions will be 75% correct. Test questions will be included on each unit examination. Seventy five percent of Management Information Systems majors will receive a score of at 75% on the Test and the Networking Project. 485


Finding
Networking Findings
The objective was assessed during the Fall 2010 semester.  Students scored 75% or better on 72% of individual questions used on the test to assess their understanding of networking technologies.  On average, the class as a whole scored 80% on questions used on the test.  Individually, 71.4% of students scored 75% or better on questions used on the test. 98.4% of students scored 75% or better on the networking project. 


Action
MIS 485
All of the objectives were not met. The faculty will build on the effectiveness of the networking project. The faculty involved with this objective will investigate the criteria and performance and will search for alternative ways to assess this objective and further break it down by sub-objective. In addition, the subjective questions on the test will be used as part of the assessment by using the same questions for all students.     



Update to previous cycle's plan for continuous improvement

Plan for continuous improvement A meeting was held May 25, 2011 with all MIS faculty present and our Department Chair.  We reviewed the assessments of both the 291 and 390 classes and discussed the results as presented above. 

We then discussed the idea of trying to assess against core competencies, as suggested by Doug Berg, rather than on a course-by-course basis .  After much discussion we decided that this wouldn't work for MIS and that we were more effectual sticking with the current approach.

The plan for next year was discussed and we decided to assess the Introduction to MIS (MGIS 3310) and e-commerce (MGIS 4320) courses in the Spring semester.  Gerald Kohers will be doing both of these courses.