LASER-TEC Evaluation Report
A mixed evaluation methodology has been used to assess and analyze the goals and objectives of this project. The following four questions have been asked to facilitate the evaluation process:
• What was proposed to be done?
• How was it planned?
• Is it being done as planned?
• Is the program successful?
Additionally, goals and objectives involving training and professional development have been evaluated using the Kirkpatrick Four-Level Model, which asks the following questions:
• To what degree are K-12 teachers, counselors, and administrators satisfied with the content and quality of LFO seminars and the center services? (Reaction Level)
• To what degree did K-12 teachers, counselors, and administrators understand the need to incorporate LFO modules in life sciences classes and career counseling? (Learning Level)
• To what degree are K-12 teachers, counselors, and administrators incorporating LFO modules in life sciences classes and career counseling? (Behavior Level)
• How many new LFO courses, modules, lessons, and career guidance sessions have been added in K-12 schools, and how many students have attended? (Results Level)
The management team has extensive meetings with the evaluator in which the goals, objectives, and tasks of this Center were discussed, analyzed, and mapped on the logic diagram that can be found in the Appendix. The evaluation plan was drafted and includes the collection of data for a continuous formative evaluation during each year of the project and a summative evaluation at the end of every year of the project. Feedback from the formative evaluations is provided to the management team on a regular basis so that corrective actions are taken immediately for effective management.
The evaluator is responsible for creating the evaluation instruments, scripts for telephone interviews, and other evaluation tools. The Center’s staff disseminates the evaluation instruments and collects the results. All results are sent to the evaluator for analysis and report preparation. The evaluator reports back to the management team and suggests changes in execution, activities, or objectives based on the evaluation findings.
A formal summative evaluation report is produced at the end of the year for NSF and also for the National Visiting Committee. The purpose of this summative evaluation is to judge the annual success of the project and also to provide the NVC with knowledge to suggest any changes or realignment of goals and objectives for the following year.
Dr. Fraser Dalgleish has extensive NSF project evaluation experience. He will continue to be the evaluator of LASER-TEC. In collaboration with the National Visiting Committee, Dr. Dalgleish developed the plan that constitutes necessary gathering the data and impact indicators for a continuous formative evaluation during each year of the project and a summative evaluation for the NVC and NSF at the end of every year of the project.
• What was proposed to be done?
• How was it planned?
• Is it being done as planned?
• Is the program successful?
Additionally, goals and objectives involving training and professional development have been evaluated using the Kirkpatrick Four-Level Model, which asks the following questions:
• To what degree are K-12 teachers, counselors, and administrators satisfied with the content and quality of LFO seminars and the center services? (Reaction Level)
• To what degree did K-12 teachers, counselors, and administrators understand the need to incorporate LFO modules in life sciences classes and career counseling? (Learning Level)
• To what degree are K-12 teachers, counselors, and administrators incorporating LFO modules in life sciences classes and career counseling? (Behavior Level)
• How many new LFO courses, modules, lessons, and career guidance sessions have been added in K-12 schools, and how many students have attended? (Results Level)
The management team has extensive meetings with the evaluator in which the goals, objectives, and tasks of this Center were discussed, analyzed, and mapped on the logic diagram that can be found in the Appendix. The evaluation plan was drafted and includes the collection of data for a continuous formative evaluation during each year of the project and a summative evaluation at the end of every year of the project. Feedback from the formative evaluations is provided to the management team on a regular basis so that corrective actions are taken immediately for effective management.
The evaluator is responsible for creating the evaluation instruments, scripts for telephone interviews, and other evaluation tools. The Center’s staff disseminates the evaluation instruments and collects the results. All results are sent to the evaluator for analysis and report preparation. The evaluator reports back to the management team and suggests changes in execution, activities, or objectives based on the evaluation findings.
A formal summative evaluation report is produced at the end of the year for NSF and also for the National Visiting Committee. The purpose of this summative evaluation is to judge the annual success of the project and also to provide the NVC with knowledge to suggest any changes or realignment of goals and objectives for the following year.
Dr. Fraser Dalgleish has extensive NSF project evaluation experience. He will continue to be the evaluator of LASER-TEC. In collaboration with the National Visiting Committee, Dr. Dalgleish developed the plan that constitutes necessary gathering the data and impact indicators for a continuous formative evaluation during each year of the project and a summative evaluation for the NVC and NSF at the end of every year of the project.
Evaluation reports are available to download:
