Evaluation Plan-SRPYS Scenario Evaluation Plan Evaluation is one of the most important steps in the development and implementation of any program or project. As imperative as it is to lay a solid foundation through mission, goals, and objectives, it is equally as important to have a way to define success or failure through use of appropriate tools, accurate reporting, and proper evaluation techniques. Deciding whether to use a process evaluation format or outcome evaluation can be challenging, but often a coordinated system is most telling.
The main objective of any evaluation technique is to provide the state of the agency and how well or poorly their programs are working, what may need to be changed, and how well they continue to meet their mission, goals and objectives. The Santa Rosa Philharmonic Youth Symphony (SRPYS) is an organization which prides itself on the development and achievements of young people; primarily in music education and excellence, but also leadership and scholarship. The community strongly supports the teaching and mentorship that this organization provides the youth of its area; recognizing that without music, life becomes dull.
Discipline is one of the primary drivers of most musicians and SRPYS encourages hard work, challenging mastership of musical talents, and performances of exceptional quality. Auditions are held each year in June for qualified candidates, but with the loss of music programs in elementary and middle schools they realize that some type of program needs to be developed to serve that group of students. The mission, goals, and objectives that are presented in the scenario are fairly generalized. Without an adequate, detailed description f how the program will be administrated and implemented, it is nearly impossible to perform a process evaluation. Evaluation Plan-SRPYS Process evaluations serve to collect the information from the program which provides the basis for outcome evaluations. Outcome evaluations take the assessments and raw data to identify how well the program has met its goals. In order to truly evaluate this agency, some academic liberties must be taken to set the groundwork. Ignoring either process will not provide an accurate estimation of any program.
The process evaluation technique requires that data be collected in many different forms. Using properly designed assessments, the process can be evaluated for efficiency, effectiveness, and the need for further extended study. In this case, evaluations may include such tools as participant, parent, and mentor surveys, interviews with staff members to evaluate the beginning and ending skills of students, community reaction to performances (including quality feedback and ticket sales) and the procedural processes which provide the opportunity for students to increase their skills.
While these tools provide the basis for outcome evaluation, the process with which they are collected is equally important. Without accurate data, the outcome will not properly reflect the true status of the organization. This program is one which is very hard to measure quantitatively because music in itself is quite subjective; each person who hears it will take something different away from the performance.
Evaluating the quality of the technical aspects of musicianship is best done by qualified individuals who are formally trained in musical study. However, community reaction is important; without feedback from the people who enjoy the musical performance, the criteria may become too stiff and unwieldy for youth. Defining the actual levels of achievement could be attained through a step process of skill levels; as students complete the different levels, statistical data could be collected which shows
Evaluation Plan-SRPYS how much time is required to complete each level, what skills were mastered, and how well the curriculum met the needs of the students using a numerical scale. There are many levels of skill that need to be addressed; rather than for just those who have exceptional talent. Outcome-based evaluation stems from taking the data collected and boiling it down into usable conclusions which allow for decision making and evaluation of the actual program.
When working with the data, it is important to keep in mind the mission, goals, and objectives of the organization; from this we can see how far the program has come, if we need to make crucial or minimal changes in curriculum, and how well we are meeting the integral parts of the program objectives. Without an accurate outcome evaluation, we have no way of knowing if the program and organizational values are on track or have deviated from their original purpose. Tools which can be used for outcome evaluation are financial and progress reports which are presented to management, community, and the Board of Directors of the organization.
A detailed comparison of where the program started, how well it met its objectives, how it met those objectives, and what direction needs to be taken for the future prosperity of the program are all valuable information. These tools help grant donors, community members, people who are considering implementing the same type of program, and other outside sources see that the organization is dedicated, the program is well designed, and that the methods it uses for evaluation are appropriate and thorough.
Evaluating any organization or program on both on a process and outcome level, provides the information needed to further the mission, goals, and objectives which drive the internal and external workings of any programs that it institutes. These aspects Evaluation Plan-SRPYS provide for the writing of new goals and objectives and allow for changes to the mission statement, if needed. Taking the time and energy to properly evaluate the process by which further outcome evaluation can be performed is essential; it shows the true nature of the rogram and how well it serves its clients. The founders, staff, students, parents, community, and executive committees need to know how well the SRPYS are meeting the needs of the community and the students that depend on it for furthering their musical talents. Evaluation Plan-SRPYS References Terao, K. , Terao, K. L. & Yuen (2003). Practical Grant Writing and Program Evaluation. Brooks and Cole/Cengage Learning, Florence, KY.