Understand and Control data collected, stored and reported throughout the university to insure appropriate accuracy
Objective
Mandated Reporting
Provide information and conduct research studies to comply with federal, state and other reporting mandates
Indicator
Tracking Mandated Reports
The IRA office will use an organized table to track when mandate reports, such as IPEDS, THECB reports, Petersons, NSF/NIH reports, US News and World Reports, etc., are received by the IRA Office, who they are assigned to, when they are completed and the locations of any relevant files.
Criterion
100% Completion of Mandated Reports
100% of mandated reports received by the IRA office will be completed.
Finding
Completion of Mandated Reports
100% of mandated reports received by the IRA office in 2006-2007 were completed.
Action
Completion of Mandated Reports
The IRA Office will continue to complete all mandated reports submitted to this office by various University Programs and Administrators, as well as those recieved from various private, State, and Federal agencies.
Action
Improve Collection of Workorder Information
In 2007-2008 the IRA Office will look to improve how it collects and maintains information submitted by clients. The office will look into using a web based application through which client information will be efficiently entered into a database.
Objective
Client Satisfaction
Federal, State, TSU System, and SHSU administrative and academic consumers of SHSU data will be satisfied with the accuracy and timeliness of data provided by the IRA Office
Indicator
SHSU Client Feedback Survey
Internal perception and satisfaction feedback surveys of consumers in the SHSU community. Will include items addressing satisfaction with accuracy, timeliness, and usefulness of data provided by the IRA Office.
Criterion
60% Client Satisfaction
A minimum 60% of survey respondents will not only be satisfied with the IRA office in general, but also with the accuracy, timeliness, and usefulness of the data they receive as a result of their work orders/data requests.
Finding
Client Satisfaction
The IRA Client satisfaction survey was sent to 103 former clients, from which was received 17 responses. This equates to a response rate of 16.5%. Of the respondents, 82.4% (14 of 17) found the materials sent to them to be useful, 82.4% (14 of 17) were satisfied with the time it took to receive their results, and 70.6% (12 of 17) were generally satisfied with the quality of service they received. The only area in which the response was negative was the area of accuracy where only 47.1% (8 of 17) reported that their results had only minor errors or were error free.
Indicator
Number Of Repeat Customers
The IRA Office will use the Workorder Request Table to track the number of repeat customers in the 2006-2007 year.
Criterion
Gather baseline for Repeat Customers
The IRA office will gather information on the number of repeat customers served in order to determine a baseline for future comparison. The IRA office would like to see an increase in the number of repeat customers in following years.
Finding
Number of Repeat Clients
37 repeat clients were found in the 2006-2007 Workorder table. Please see the attached list for a full count of the repeat clients. This information will be used as a baseline for future evaluations of the number of repeat clients serviced by the Office of Institutional Research and Assessment.
Action
Improving Client Satisfaction
If the different areas of client satisfaction measured by the IRA Office, Accuracy was the one that most dissatisfied clients. Most of these issues may have been the result of clients not understanding the timing of different reports received and issued by the IRA Office. In an effort to correct this, the IRA Office has taken steps to educate clients as to when and where differences in data due to the timing of reports may occur. In addition, the IRA Office has set into motion procedures to improving the consistency of various reports by "freezing" key data sets that can then be used as snapshots from different reports can be completed.
Action
Improving Measuring Client Satisfaction
As the response rate for the Client Satisfaction Survey was only about 16%, the IRA Office will investigate ways to improve the process and increase the response rate. One such method may be automatically incorporating the survey into the e-mail that is used to send the client their completed request.
Objective
Data Consistency
State and TSU System consumers of SHSU data will perceive consistency across reports and surveys in SHSU data for common key indicators and outcomes provided by the IRA Office
Indicator
Multi-source Datapoint Checks
Consistency Check with Common key-indicators used by State Agencies and TSU System. Data and reports produced by the IRA office will be compared with comparable data contained in various GUI, Nell, THECB, and IPED's reports.
Criterion
Accuracy of IRA Data
Data produced by the IRA office will be 95% accurate in comparisons with other date, when the timing and definitions of the data do not vary.
Finding
Accuracy of IRA Data/Reports
In general, most discrepancies were found to be because of differences in definitions and timing. As such it was difficult to determine the exact percentage of accuracy of IRA data and reports. It has become clear that steps must be taking internally to make the process of quality control less time consuming and more efficient.
Action
Improving the Accuracy of IRA Data/Reports
The IRA office has taken great steps to improve communication with the Universities Computer Services division in an effort to resolve the descrepancies that resulted from differences in timing and definitions. As a result of these discussions, it has been decided that key data and reports will be "frozen" at various times throughout the academic year, and that this frozen data will be used to provide consistent reports for various departments and agencies. In addtion to these external efforts, the IRA office will continue to streamline and modify is procedures for checking data/reports in an effort to make that process more time efficient.
Goal
Evidence-based culture
Promote evidence-based reflection, planning, and action on behalf of the university.
Objective
Assist Various Accreditation Assessments
Provides technical assistance in validating and documenting those processes for the reaffirmation of accreditation by the Southern Association of Colleges and Schools.
Indicator
Tracking Assistance SACS Reaffirmation
The IRA office will collect e-mails, sign-in sheets and the Workorder Request Table to track the level and types of assistance provided to the University community in regards to the SACS reaffirmation process.
Criterion
Assistance with SACS reaffirmation
The IRA office will satisfy all requests for assistance in regards to the SACS reaffirmation process.
Finding
Assistance with SACS reaffirmation
The IRA Office has provided a variety of assistance in regard to the Universities SACS reaffirmation efforts. Numerous training sessions have been conducted to instruct university members in the operation of the Online Assessment Tracking Database (OAT Db), a key component in the Universities SACS efforts. Since the conclusion of the training sessions in March, the IRA office has continued to provide hands on training and assistance with the various departments and divisions as needed.
Action
Continuing Assistance with SACS Reaffirmation
The Office of Institutional Research and Assessment will continue its efforts to assist University programs and departments with the SACS reaffirmation process, as well as continue to provide advice and technical support with the Online Assessment Tracking Database (OAT Db).
Objective
Client Satisfaction
Federal, State, TSU System, and SHSU administrative and academic consumers of SHSU data will be satisfied with the accuracy and timeliness of data provided by the IRA Office
Indicator
SHSU Client Feedback Survey
Internal perception and satisfaction feedback surveys of consumers in the SHSU community. Will include items addressing satisfaction with accuracy, timeliness, and usefulness of data provided by the IRA Office.
Criterion
60% Client Satisfaction
A minimum 60% of survey respondents will not only be satisfied with the IRA office in general, but also with the accuracy, timeliness, and usefulness of the data they receive as a result of their work orders/data requests.
Finding
Client Satisfaction
The IRA Client satisfaction survey was sent to 103 former clients, from which was received 17 responses. This equates to a response rate of 16.5%. Of the respondents, 82.4% (14 of 17) found the materials sent to them to be useful, 82.4% (14 of 17) were satisfied with the time it took to receive their results, and 70.6% (12 of 17) were generally satisfied with the quality of service they received. The only area in which the response was negative was the area of accuracy where only 47.1% (8 of 17) reported that their results had only minor errors or were error free.
Indicator
Number Of Repeat Customers
The IRA Office will use the Workorder Request Table to track the number of repeat customers in the 2006-2007 year.
Criterion
Gather baseline for Repeat Customers
The IRA office will gather information on the number of repeat customers served in order to determine a baseline for future comparison. The IRA office would like to see an increase in the number of repeat customers in following years.
Finding
Number of Repeat Clients
37 repeat clients were found in the 2006-2007 Workorder table. Please see the attached list for a full count of the repeat clients. This information will be used as a baseline for future evaluations of the number of repeat clients serviced by the Office of Institutional Research and Assessment.
Action
Improving Client Satisfaction
If the different areas of client satisfaction measured by the IRA Office, Accuracy was the one that most dissatisfied clients. Most of these issues may have been the result of clients not understanding the timing of different reports received and issued by the IRA Office. In an effort to correct this, the IRA Office has taken steps to educate clients as to when and where differences in data due to the timing of reports may occur. In addition, the IRA Office has set into motion procedures to improving the consistency of various reports by "freezing" key data sets that can then be used as snapshots from different reports can be completed.
Action
Improving Measuring Client Satisfaction
As the response rate for the Client Satisfaction Survey was only about 16%, the IRA Office will investigate ways to improve the process and increase the response rate. One such method may be automatically incorporating the survey into the e-mail that is used to send the client their completed request.
Goal
Provide resources to measure excellence
Support the pursuit of excellence within university units by providing assistance with self-improvement assessment
Objective
Mandated Reporting
Provide information and conduct research studies to comply with federal, state and other reporting mandates
Indicator
Tracking Mandated Reports
The IRA office will use an organized table to track when mandate reports, such as IPEDS, THECB reports, Petersons, NSF/NIH reports, US News and World Reports, etc., are received by the IRA Office, who they are assigned to, when they are completed and the locations of any relevant files.
Criterion
100% Completion of Mandated Reports
100% of mandated reports received by the IRA office will be completed.
Finding
Completion of Mandated Reports
100% of mandated reports received by the IRA office in 2006-2007 were completed.
Action
Completion of Mandated Reports
The IRA Office will continue to complete all mandated reports submitted to this office by various University Programs and Administrators, as well as those recieved from various private, State, and Federal agencies.
Action
Improve Collection of Workorder Information
In 2007-2008 the IRA Office will look to improve how it collects and maintains information submitted by clients. The office will look into using a web based application through which client information will be efficiently entered into a database.
Objective
Assist Various Accreditation Assessments
Provides technical assistance in validating and documenting those processes for the reaffirmation of accreditation by the Southern Association of Colleges and Schools.
Indicator
Tracking Assistance SACS Reaffirmation
The IRA office will collect e-mails, sign-in sheets and the Workorder Request Table to track the level and types of assistance provided to the University community in regards to the SACS reaffirmation process.
Criterion
Assistance with SACS reaffirmation
The IRA office will satisfy all requests for assistance in regards to the SACS reaffirmation process.
Finding
Assistance with SACS reaffirmation
The IRA Office has provided a variety of assistance in regard to the Universities SACS reaffirmation efforts. Numerous training sessions have been conducted to instruct university members in the operation of the Online Assessment Tracking Database (OAT Db), a key component in the Universities SACS efforts. Since the conclusion of the training sessions in March, the IRA office has continued to provide hands on training and assistance with the various departments and divisions as needed.
Action
Continuing Assistance with SACS Reaffirmation
The Office of Institutional Research and Assessment will continue its efforts to assist University programs and departments with the SACS reaffirmation process, as well as continue to provide advice and technical support with the Online Assessment Tracking Database (OAT Db).
Objective
Data Consistency
State and TSU System consumers of SHSU data will perceive consistency across reports and surveys in SHSU data for common key indicators and outcomes provided by the IRA Office
Indicator
Multi-source Datapoint Checks
Consistency Check with Common key-indicators used by State Agencies and TSU System. Data and reports produced by the IRA office will be compared with comparable data contained in various GUI, Nell, THECB, and IPED's reports.
Criterion
Accuracy of IRA Data
Data produced by the IRA office will be 95% accurate in comparisons with other date, when the timing and definitions of the data do not vary.
Finding
Accuracy of IRA Data/Reports
In general, most discrepancies were found to be because of differences in definitions and timing. As such it was difficult to determine the exact percentage of accuracy of IRA data and reports. It has become clear that steps must be taking internally to make the process of quality control less time consuming and more efficient.
Action
Improving the Accuracy of IRA Data/Reports
The IRA office has taken great steps to improve communication with the Universities Computer Services division in an effort to resolve the descrepancies that resulted from differences in timing and definitions. As a result of these discussions, it has been decided that key data and reports will be "frozen" at various times throughout the academic year, and that this frozen data will be used to provide consistent reports for various departments and agencies. In addtion to these external efforts, the IRA office will continue to streamline and modify is procedures for checking data/reports in an effort to make that process more time efficient.
Objective
Clients Understand & Use Data
SHSU decision makers will be able to use and understand the data they are provided by the IRA Office
Indicator
SHSU Client Feedback Survey
Internal perception and satisfaction feedback surveys of consumers in the SHSU community. Will include items addressing satisfaction with accuracy, timeliness, and usefulness of data provided by the IRA Office.
Criterion
60% Client Satisfaction
A minimum 60% of survey respondents will not only be satisfied with the IRA office in general, but also with the accuracy, timeliness, and usefulness of the data they receive as a result of their work orders/data requests.
Finding
Client Satisfaction
The IRA Client satisfaction survey was sent to 103 former clients, from which was received 17 responses. This equates to a response rate of 16.5%. Of the respondents, 82.4% (14 of 17) found the materials sent to them to be useful, 82.4% (14 of 17) were satisfied with the time it took to receive their results, and 70.6% (12 of 17) were generally satisfied with the quality of service they received. The only area in which the response was negative was the area of accuracy where only 47.1% (8 of 17) reported that their results had only minor errors or were error free.
Indicator
Number Of Repeat Customers
The IRA Office will use the Workorder Request Table to track the number of repeat customers in the 2006-2007 year.
Criterion
Gather baseline for Repeat Customers
The IRA office will gather information on the number of repeat customers served in order to determine a baseline for future comparison. The IRA office would like to see an increase in the number of repeat customers in following years.
Finding
Number of Repeat Clients
37 repeat clients were found in the 2006-2007 Workorder table. Please see the attached list for a full count of the repeat clients. This information will be used as a baseline for future evaluations of the number of repeat clients serviced by the Office of Institutional Research and Assessment.
Action
Ensuring that Clients Can Understand and Use Data
The IRA Office will continue to respond to the needs and requests from its various clients; as well as continue to assist clients improve the methods by which they capture their own program data. In addition, the IRA Office will continue to educate it clients regarding the nuances of the data received by our office and the impact it can have on various reports so that clients can get the maximum amount of use from their requests.
Goal
Sharing and Exchange
Support and assist in grass roots exchange and sharing of ideas, goals, and objectives amongst units and programs.
Objective
Assist Various Accreditation Assessments
Provides technical assistance in validating and documenting those processes for the reaffirmation of accreditation by the Southern Association of Colleges and Schools.
Indicator
Tracking Assistance SACS Reaffirmation
The IRA office will collect e-mails, sign-in sheets and the Workorder Request Table to track the level and types of assistance provided to the University community in regards to the SACS reaffirmation process.
Criterion
Assistance with SACS reaffirmation
The IRA office will satisfy all requests for assistance in regards to the SACS reaffirmation process.
Finding
Assistance with SACS reaffirmation
The IRA Office has provided a variety of assistance in regard to the Universities SACS reaffirmation efforts. Numerous training sessions have been conducted to instruct university members in the operation of the Online Assessment Tracking Database (OAT Db), a key component in the Universities SACS efforts. Since the conclusion of the training sessions in March, the IRA office has continued to provide hands on training and assistance with the various departments and divisions as needed.
Action
Continuing Assistance with SACS Reaffirmation
The Office of Institutional Research and Assessment will continue its efforts to assist University programs and departments with the SACS reaffirmation process, as well as continue to provide advice and technical support with the Online Assessment Tracking Database (OAT Db).
Goal
Serve entire university
Service and support all units within Sam Houston State University.
Objective
Assist Various Accreditation Assessments
Provides technical assistance in validating and documenting those processes for the reaffirmation of accreditation by the Southern Association of Colleges and Schools.
Indicator
Tracking Assistance SACS Reaffirmation
The IRA office will collect e-mails, sign-in sheets and the Workorder Request Table to track the level and types of assistance provided to the University community in regards to the SACS reaffirmation process.
Criterion
Assistance with SACS reaffirmation
The IRA office will satisfy all requests for assistance in regards to the SACS reaffirmation process.
Finding
Assistance with SACS reaffirmation
The IRA Office has provided a variety of assistance in regard to the Universities SACS reaffirmation efforts. Numerous training sessions have been conducted to instruct university members in the operation of the Online Assessment Tracking Database (OAT Db), a key component in the Universities SACS efforts. Since the conclusion of the training sessions in March, the IRA office has continued to provide hands on training and assistance with the various departments and divisions as needed.
Action
Continuing Assistance with SACS Reaffirmation
The Office of Institutional Research and Assessment will continue its efforts to assist University programs and departments with the SACS reaffirmation process, as well as continue to provide advice and technical support with the Online Assessment Tracking Database (OAT Db).
Objective
Clients Understand & Use Data
SHSU decision makers will be able to use and understand the data they are provided by the IRA Office
Indicator
SHSU Client Feedback Survey
Internal perception and satisfaction feedback surveys of consumers in the SHSU community. Will include items addressing satisfaction with accuracy, timeliness, and usefulness of data provided by the IRA Office.
Criterion
60% Client Satisfaction
A minimum 60% of survey respondents will not only be satisfied with the IRA office in general, but also with the accuracy, timeliness, and usefulness of the data they receive as a result of their work orders/data requests.
Finding
Client Satisfaction
The IRA Client satisfaction survey was sent to 103 former clients, from which was received 17 responses. This equates to a response rate of 16.5%. Of the respondents, 82.4% (14 of 17) found the materials sent to them to be useful, 82.4% (14 of 17) were satisfied with the time it took to receive their results, and 70.6% (12 of 17) were generally satisfied with the quality of service they received. The only area in which the response was negative was the area of accuracy where only 47.1% (8 of 17) reported that their results had only minor errors or were error free.
Indicator
Number Of Repeat Customers
The IRA Office will use the Workorder Request Table to track the number of repeat customers in the 2006-2007 year.
Criterion
Gather baseline for Repeat Customers
The IRA office will gather information on the number of repeat customers served in order to determine a baseline for future comparison. The IRA office would like to see an increase in the number of repeat customers in following years.
Finding
Number of Repeat Clients
37 repeat clients were found in the 2006-2007 Workorder table. Please see the attached list for a full count of the repeat clients. This information will be used as a baseline for future evaluations of the number of repeat clients serviced by the Office of Institutional Research and Assessment.
Action
Ensuring that Clients Can Understand and Use Data
The IRA Office will continue to respond to the needs and requests from its various clients; as well as continue to assist clients improve the methods by which they capture their own program data. In addition, the IRA Office will continue to educate it clients regarding the nuances of the data received by our office and the impact it can have on various reports so that clients can get the maximum amount of use from their requests.