OATdb Archive

2014 - 2015

Institutional Effectiveness

Goal
Collect, Analyze And Disseminate Institutional Data And Relevant Information In An Accurate, Timely And Understandable Manner
Institutional Effectiveness will continue to develop tools available to users such as Data Cookbook and Cognos.


Objective
Data Cookbook Access
Facilitate the ability for faculty, staff, and administration to have access to common Cognos reports in a user friendly interface, Data Cookbook.

KPI
Data Work Order Reduction
Data Cookbook will reduce the number of work orders for data that can be obtained through Data Cookbook rather than pulled by an Institutional Effectiveness analyst.

Result
Data Cookbook Development
Data Cookbook has seen significant development.  It is used by faculty, staff, and administration to locate and access reports, determine the terms of the report, which department owns the report, and request any new reports.

Action
Data Cookbook Video Presentation
In an effort to "roll out" the Data Cookbook, a video presentation of how to use it has been created that will be released to SHSU faculty, staff, and administration.  In person training will also be offered for users who require more.

Goal
Contribute Materially In The University-wide Process For Continuous Improvement By Assisting Administrative Units In The Evaluation Of Operations
Administrative Program Review has completed 3 reviews and has two in the final stages within the Enrollment Management Division.  APR will expand into Academic Affairs in the coming year with 5 departments identified.


Objective
Administrative Program Review Process Expansion
Expand the Administrative Program Review Process into more University departments.

KPI
APR Process Improvement
Continue to conduct and improve the APR process to units within Enrollment Services, completing at least 5 units.

Result
APR Completion
APR has been completed in 3 units with 2 more in the final phase.

Action
Academic Affairs' APR Expansion
APR will expand into Academic Affairs in the coming year.

Objective
Administrative Program Review Evaluation
Administrative Program Review will be evaluated by the department undergoing the review.  APR will receive a satisfactory rating in this review.

KPI
APR Process Rating
The APR Process will receive a rating of at least satisfied on the evaluation rubric completed by the administrative department under review.

Result
Action Plan Perceptions
The only concern after the survey results is that the departments may not see the Action Plan as useful and realistic.

Action
APR Compatability
APR will work to show departments how the Action Plan will work with their OATdb and departmental strategic plan.

Goal
Improve Office Of Institutional Effectiveness Satisfaction
Improve Office of Institutional Effectiveness work order management and fulfillment strategies so that measurable improvement in quantity and user satfisfaction occur.

Objective
Track And Evaluate User Satisfaction
Track and Evaluate User Satisfaction - Increase the overall satisfaction level of those who receive data requests.


KPI
Post Fulfillment Survey
Post Fulfillment Survey – Evaluate user satisfaction via survey.


Result
Post Fulfillment Survey Complete
 Institutional Effectiveness issued an invitation via email to individuals who requested data through the IE work order process from Fall 2014 – Spring 2015.  The results of the survey were compared to the results of the same survey issued for Fall 2012 – Summer 2013 and Fall 2013-Summer 2014.  In terms of positive and negative changes by topic or question,the results are as follows:                                                                
1. Did you receive the information you requested? improvement
2. Please indicate your level of satisfaction with the customer service received from the staff –slight improvement
3. Please indicate your level of satisfaction with the response time in starting your request-slight loss
4. Please indicate your level of satisfaction with the time required to complete your request-slight loss
5. Please indicate your level of satisfaction with the presentation style or format of the response-slight loss
6. Please indicate your level of satisfaction with the usefulness of the response/data to your project/work-slight improvement
7. Please indicate your level of satisfaction with the clarity of Written Explanations-slight loss
8. Please indicate your level of satisfaction with the clarity of the Oral Explanation-slight improvement
9. Please indicate your level of satisfaction with the thoroughness of Written Explanations-slight improvement
10. Please indicate your level of satisfaction with the thoroughness of Oral Explanation-slight improvement

Action
Consider Making Changes
Institutional Effectiveness had double the response rate on this survey than in the past.  In previous years, the participation rate was around 25 participants, by waiting a little later in the year there was a significant increase in the participation rate.  The losses comparatively are not very significant, however, it does point out working on turning out data faster does need to be considered for optimum performance. In next year’s survey, if the participant gives a negative response, a comment will be required. IE also implemented a system by which every person on campus who submits a work order will receive a follow-up call after they have received their requested data.  The feedback received in those calls has all been very positive.


Update to previous cycle's plan for continuous improvement IE has a full time staff person devoted to Data Cookbook.  She has developed a training video for new users, and it is posted on the IE website.  Membership in the Data Cookbook grows as users are added voluntarily as the word gets out.  Changes in the Finance & Operations division has created a gap in the support for posting information about F&O reports, so IE will expand coverage and pick up where the last person left off.

IE has completed approximately 3 new Cognos reports and serves the university by modifying existing reports.  The university has budgeted funds for IE to hire an analyst to specialize in Cognos writing in FY16.

In spring 2015, APR was conducted in Career Services, Visitors Center and Veterans Resource Center.  The Registrar's Office praises the experience and continues to find opportunities to use the self study to improve the department.

The Assistant Director for IR position opened with the separation of Dr. Rideout.  After a thorough search, Senior Analyst, Xiaohong Li, was selected for promotion to the AD for IR position.  She has initiated contact with IT to merge IE's work order process into Cherwell, creating opportunities for reporting and automation.

The 2015 Texas Legislative session was busy and IE offered routine handling of Fiscal Note/Impact requests from TSUS and the LBB.  The work flow included initial research and analysis of bills by Donna Artho, who passed along summary and detail data to VP for Finance, Carlos Hernandez, Controller, Aaron LeMay, and Budget Director, Edgar Smith. 

Plan for continuous improvement Data Cookbook will need to be populated with more reports in the Student module and Finance module before pushing the information out to the general campus.  It is estimated the progress is about 60% complete.

The APR process will begin outside of Enrollment Management in 2016 starting with the SAM Center.  The variations in the EM and Academic Affairs divisions will impact the APR process, and Jamie Stein will document the nuances that create the need to modify the manner in which the process has occured to date.

The demand for new Cognos reports is almost insatiable, so IE will need to be very careful in accepting reports on a short time line so that users are not dissatisfied with the timeline.