Promote An Environment That Encourages Continuous Improvement Of Assessment Initiatives
The Office of Academic Planning and Support will encourage and promote an environment of continuous improvement at Sam Houston State University.
Objective
Provide Quality Assessment Support Resources
The Office of Academic Planning and Assessment will provide quality assessment resources to the University community through both its website and ongoing training sessions and workshops.
KPI
Successful Creation Of New Office Website
The Office of Academic Planning and Assessment was formally created in September, 2012. Therefore, during the 2012-2013 cycle the Office will successfully create a new website providing information and resources.
Result
Successful Launch Of Academic Planning And Assessment Website
The website for the Office of Academic Planning and Assessment went live on August 2, 2013. This website contains information and resources regarding assessment, accreditation, and strategic planning. Our office will continue to expand and improve the resources provided through the website on a continual basis.
KPI
Satisfaction With Workshops/Training
Training session attendees will complete a brief survey, consisting of one Likert-scale question and three open-response questions, which indicate their satisfaction with the services provided by the Office of Academic Planning and Assessment. A copy of the survey is provided as an attachment. The average response to the Likert-scale question should be 4 or higher, indicating that they were satisfied with the services provided by our Office. Additionally, respondent comments from the three open-response questions should be generally positive.
Result
Satisfaction With Workshops And Training For 2012-2013
The Office of Academic Planning and Assessment conducted 7 formal assessment workshops and numerous individual training sessions. The average rating for the Likert-scale question for all respondents was 4.43. The survey responses can be further broken down between formal workshops given by the Office of Academic Planning and Assessment and individual training sessions. The average rating for the workshops was 4.39, while the average rating for the individual training sessions was 5.
Responses to the open ended questions on the survey were also positive, with a number of respondents requesting that the Office of Academic Planning and Assessment host additional formal workshops.
Please see the attached reports for a fuller breakdown of the survey results for both the formal workshops and individual training sessions.
KPI
Number Of Workshops/Training Sessions Held
The Office of Academic Planning and Assessment will conduct at least 25 workshops/training sessions related to the annual assessment process being conducted at SHSU. These sessions may range from large, group workshops to individual training sessions.
Result
Number Of Workshops/Training Sessions Held For 2012-2013
As of 9/1/2013, the Office of Academic Planning and Assessment has conducted 37 workshops or training sessions for the SHSU community. These sessions can be broken down as follows: 11 Assessment Workshops, 8 small-group OATDB training sessions, 18 small-group assessment meetings. This number represents a great success, given that the new Director of Assessment did not join the Department until January, 2013 and that workshops, training sessions, and meetings were not tracked until February, 2013.
Action
Improving Assessment Support Resources
In all, the Office of Academic Planning and Assessment experienced great success in providing quality assessment support resources to the University community during the 2012-2013 cycle. For 2013-2014 the Office wants to continue to build upon that success and continue to improve to quality of assessment resources provided to the University.
The new Academic Planning and Assessment website will serve as a digital warehouse of assessment related documents and information. During the next year, the Office hopes to add a number of additional documents, including: copies formal presentations about assessment and the OATDB, examples of best practices in assessment, an assessment FAQ, and an updated OATDB user guide. The Office will also explore ways of using available metrics to assess the usage of our website.
While the Office was pleased with the overall number of workshops held and the campus response to them, it is cognizant of the desire for more formalized training sessions. As such the Office would like to increase the number of presentations given across campus. Specifically, it desires to increase both the number and variety of formal assessment workshops and individual/small group OATDB training sessions. The Office is working to develop and implement new formal workshops on several topics, including: introduction to the OATDB, developing an assessment plan, and using assessment results for continuous improvement. It will also continue to reach out to the university community to offer assistance and training with the OATDB.
Objective
Ensure Quality Annual Assessment Processes
The Office of Academic Planning and Assessment will ensure that members of the University community are conducting a quality, and effective, annual assessment processes.
KPI
Annual Meta-assessment Process
Using a locally developed rubric designed to evaluate the overall quality of a program's annual assessment plan and report, the Office of Academic Planning and Assessment will facilitate an annual review of assessment plans stored within the Online Assessment Tracking Database (OATDB). The results of this evaluation should indicate that 75%, or more, of the reviewed assessment plans for each College/Division should be rated as “Acceptable” or better. For programs that had received training from the Office of Academic Planning and Assessment, the rate should be 85%. Additionally 75%, or more, of the total number of assessment plans reviewed from across the University should be rated “Acceptable” or better.
Result
Review Of 2011-2012 Assessment Plans Is On-going
The Office of Academic Planning and Assessment successfully developed a meta-assessment rubric and as of time of submission, the review of assessment plans from the 2011-2012 is not yet complete. This review will be finished during the Fall 2013 semester and will serve as a base line for the meta-assessment review of assessment plans from the 2012-2013 assessment cycle.
Action
Full Implementation Of Meta-assessment Process
While the Office of Academic Planning and Assessment successfully developed a meta-assessment rubric and began reviewing assessment plans from the 2011-2012 assessment cycle, this review was not complete by the end of the 2012-2013 period. This review should be finished during the Fall 2013 semester. Data from this review serve as a baseline for subsequent meta-assessment reviews.
Additionally, the Office of Academic Planning and Assessment will begin implementing the next step of the meta-assessment process. It will organize a committee, comprised of members from each academic college, to review assessment plans from the 2012-2013 assessment period. An additional review of non-academic units will be piloted within the Student Services Division. These reviews should be complete by December, 2013.
Goal
Support And Facilitate The Undergraduate Program Review Process
The Office of Academic Planning and Assessment will support and facilitate the Undergraduate Program Review Process as Sam Houston State University.
Objective
Facilitate A Quality Undergraduate Program Review Process
The Office of Academic Planning and Assessment will facilitate a quality undergraduate program review process through the creation of formal policies and guidelines, program review templates, and acquisition of program-specific data. Such resources will be made available through the Office website and print materials.
KPI
Undergraduate Program Review Guidelines
Development and approval of formal policies and guidelines for Undergraduate Program Review.
Result
In-progress Guidelines For Undergraduate Program Review
With the addition of a support staff within the Office of Academic Planning and Assessment, work began on the development of formal Undergraduate Program Review guidelines, templates, and timelines. The draft documents are nearing completion, with an anticipated review for approval by Council of Academic Deans scheduled for November, 2013.
KPI
Successful Creation Of New Office Website
The Office of Academic Planning and Assessment was formally created in September, 2012. Therefore, during the 2012-2013 cycle the Office will successfully create a new website providing information and resources.
Result
Successful Launch Of Academic Planning And Assessment Website
The website for the Office of Academic Planning and Assessment went live on August 2, 2013. This website contains information and resources regarding assessment, accreditation, and strategic planning. Our office will continue to expand and improve the resources provided through the website on a continual basis.
Action
Further Develop Undergraduate Program Review Process
The Undergraduate Program Review process is still under development at SHSU. The new Academic Planning and Assessment website will serve as a digital warehouse for documents and information regarding Undergraduate Program Review as those documents are finalized. The Office will explore ways of using available metrics to assess the usage of our website.
As of August, 2012, a new full-time staff member was hired to help facilitate the Undergraduate Program Review Process. With this new hire it is anticipated that much additional progress will be made toward finalizing and instituting this new process. During the 2013-2014 cycle the draft guidelines, templates, and timelines will be presented to the Council of Academic Deans for review and approval. Implementation is projected for the Spring 2014 semester through a small, pilot group.
Goal
Support The Institution's Ongoing Southern Association Of Colleges And Schools Commission On Colleges (SACSCOC) Accreditation Efforts
The Office of Academic Planning and Assessment will support the intstitution's ongoing efforts to respond to all SACSCOC requirements for maintaining accreditation.
Objective
Facilitate Completion Of The SACSCOC Fifth-Year Interim Report
The Office of Academic Planning and Assessment will work with the University community to ensure the successful completion of the SACSCOC Fifth-Year Interim Report. To this end, the Office will work to disseminate information and resources, provide necessary training, and complete and submit all required documents.
KPI
Successful Creation Of New Office Website
The Office of Academic Planning and Assessment was formally created in September, 2012. Therefore, during the 2012-2013 cycle the Office will successfully create a new website providing information and resources.
Result
Successful Launch Of Academic Planning And Assessment Website
The website for the Office of Academic Planning and Assessment went live on August 2, 2013. This website contains information and resources regarding assessment, accreditation, and strategic planning. Our office will continue to expand and improve the resources provided through the website on a continual basis.
KPI
Address Functional Deficits In Faculty Credentials Reporting System
Following the institution's conversion from a 'home-grown' ERP system to Banner, some functionality relating to Faculty Credentials reporting was lost. Steps will be taken to correct functional aspects of programming to include centralizing faculty degree entry into Banner and alteration of existing reports to align with new Banner structure.
Result
Address Functional Deficits In Faculty Credentials Reporting
During the 2012-2013 cycle, the Office of Academic Planning and Assessment worked with Information Technology to address the functional deficits in the Faculty Credentials Reporting system following the conversion to Banner. The reporting system was corrected to allow for accurate display of course information (syllabi and catalog descriptions), faculty degrees, and other qualifications. Efforts continue to convert faculty degree data from its existing external source to the Banner database.
KPI
Satisfaction With Workshops/Training
Training session attendees will complete a brief survey, consisting of one Likert-scale question and three open-response questions, which indicate their satisfaction with the services provided by the Office of Academic Planning and Assessment. A copy of the survey is provided as an attachment. The average response to the Likert-scale question should be 4 or higher, indicating that they were satisfied with the services provided by our Office. Additionally, respondent comments from the three open-response questions should be generally positive.
Result
Satisfaction With Workshops And Training For 2012-2013
The Office of Academic Planning and Assessment conducted 7 formal assessment workshops and numerous individual training sessions. The average rating for the Likert-scale question for all respondents was 4.43. The survey responses can be further broken down between formal workshops given by the Office of Academic Planning and Assessment and individual training sessions. The average rating for the workshops was 4.39, while the average rating for the individual training sessions was 5.
Responses to the open ended questions on the survey were also positive, with a number of respondents requesting that the Office of Academic Planning and Assessment host additional formal workshops.
Please see the attached reports for a fuller breakdown of the survey results for both the formal workshops and individual training sessions.
KPI
Number Of Workshops/Training Sessions Held
The Office of Academic Planning and Assessment will conduct at least 25 workshops/training sessions related to the annual assessment process being conducted at SHSU. These sessions may range from large, group workshops to individual training sessions.
Result
Number Of Workshops/Training Sessions Held For 2012-2013
As of 9/1/2013, the Office of Academic Planning and Assessment has conducted 37 workshops or training sessions for the SHSU community. These sessions can be broken down as follows: 11 Assessment Workshops, 8 small-group OATDB training sessions, 18 small-group assessment meetings. This number represents a great success, given that the new Director of Assessment did not join the Department until January, 2013 and that workshops, training sessions, and meetings were not tracked until February, 2013.
Action
Continue To Provide Training And Resources Regarding SACSCOC And The Fifth-Year Interim Report
In all, the Office of Academic Planning and Assessment experienced success in providing resources regarding SACSCOC and the Fifth-Year Interim Report to the University community during the 2012-2013 cycle. For 2013-2014 the Office wants to continue to build upon that success.
The new Academic Planning and Assessment website will serve as a digital warehouse for information relating to both SACSCOC and the Fifth-Year Interim Report. The Office will also explore ways of using available metrics to track and assess the usage of these resources.
Additionally, the Office experienced great success in conducting workshops and training sessions during 2012-2013, and was greatly satisfied with the campus response; however, it wishes to expand workshop and training offerings in 2013-2014. While increased offerings relating to the OATDB and assessment in general will be useful, other more specific sessions will be necessary as we prepare for the Fifth-Year Interim Report. The Office will increase the number, as necessary, of meetings and training sessions held specifically relating to that report to ensure its timely and successful submission in March 2015.
Finally, the Office will strive to convert faculty degree information to the Banner database to facilitate a more efficient faculty credential reporting process. In addition, the Office will develop and implement a faculty credentials justification form to be used in the hiring process. The form will be required for all faculty hires not holding the terminal degree within the discipline. This up-front justification process will facilitate more timely credentials reporting processes and aid in internal, SACSCOC compliance audits.
Objective
Ensure Institutional Compliance With And Timely Submission Of Required SACSCOC Documentation
The Office of Academic Planning and Assessment will work with the University administration to ensure that all required SACSCOC documents are submitted timely, and appropriately.
KPI
Appropriate Submission Of SACSCOC Required Documentation
The SACSCOC liaison, and the Office of Academic Planning and Assessment, will ensure that all required SACSCOC documents, such as Institutional Profiles, Letters of Notification, Prospectuses, Institutional Profiles, etc., will be summited timely and appropriately to the SACSCOC.
Result
Appropriate Submission Of SACSCOC Required Documents
Documentation required by SACSCOC was submitted on time, or in advance, of notification requirements.
Action
Substantive Change Notification Policy Review
While documentation submitted to SACSCOC was completed in a timely manner, attendance by the SACSCOC Liaison at the 2013 SACSCOC Summer Institute revealed a need to review the institution's Substantive Change Notification Policy. Recent clarification on SACSCOC reporting policies and guidelines are not reflected in SHSU's current policy. The SACSCOC Liaison will review the existing policy, make recommendations for modifications, and submit to the Council of Academic Deans for review and approval.
Goal
Support The Strategic Planning Process For The Division Of Academic Affairs
The Office of Academic Planning and Assessment will support the ongoing strategic planning process underway within the Division of Academic Affairs.
Objective
Provide Quality Strategic Planning Resources And Processes
The Office of Academic Planning and Assessment will provide quality strategic planning resources and facilitate effective planning processes within the Division of Academic Affairs.
KPI
Facilitate Development Of A Comprehensive And Quality Academic Affairs Strategic Plan
The Office of Academic Planning and Assessment will facilitate strategic planning discussions within Academic Affairs, providing the necessary resources and structure to the process. Planning meetings and retreats will be scheduled and data resources provided as needed.
Result
Facilitation Of Planning Activities
During the 2012-2013 cycle, academic administrators met to discuss the overall goals of a strategic planning process within Academic Affairs at SHSU. Progress was made in identifying the scope of the Academic Affairs strategic plan, to include a timeframe and a set of guiding questions. The necessary steps in developing a comprehensive and quality strategic planning process are ongoing and will extend into the 2013-2014 assessment cycle.
KPI
Successful Creation Of New Office Website
The Office of Academic Planning and Assessment was formally created in September, 2012. Therefore, during the 2012-2013 cycle the Office will successfully create a new website providing information and resources.
Result
Successful Launch Of Academic Planning And Assessment Website
The website for the Office of Academic Planning and Assessment went live on August 2, 2013. This website contains information and resources regarding assessment, accreditation, and strategic planning. Our office will continue to expand and improve the resources provided through the website on a continual basis.
Action
Further Develop Strategic Planning Process And Resources
The division of Academic Affairs is currently seeking to move from a year-to-year planning cycle focused primarily on management strategies to a more comprehensive, long-term, guiding planning process. A Strategic Planning Retreat is scheduled for October, 2013 to continue planning discussions. Planning will progress throughout the 2013-2014 assessment cycle, with a formalized and comprehensive Academic Affairs Strategic Plan to be published in mid- to late-2014.
The new Academic Planning and Assessment website will serve as a digital warehouse for documents and information regarding Strategic Planning to ensure broad-based planning awareness and participation. The Office will explore ways of using available metrics to assess the usage of the website.