Research into effectiveness

The Oregon State University SMILE program serves 700 
historically-underrepresented low income, first generation and 
minority students, grades 4-12, by providing enriching educational 
experiences in after-school clubs with the goal of increasing the 
retention and higher education attainment of these students.  We also 
work with 75+ teachers in the 12 school districts and communicate 
with families about educational options for their children.  Each 
year we hold a cap-stone event for each level: elementary, an outdoor 
environmental science camp at the Oregon 4-H center; middle and high, 
challenge events on Western Oregon and Oregon States campuses.

The majority of our assessments have been either specific to events 
and the club experience or in keeping track of students through an 
on-going database of students participation and retention.  Their 
focus has been program evaluation.  Through these measures we feel 
assured that we are doing quite well.

We are aware of other issues and wish to design tools, develop a 
sensible story, as to the impact we are having, why what we do works. 
In part we are growing and as we bring new people on-board we need a 
"data grounded story" about our program.

To start this process, we have pulled out what we see as the 
essential attributes of our program: a strong sense of safety, an 
inclusive community, cooperative contributions, and high expectations 
and positive attitudes.  We also are aware that we need to better 
recruit all stakeholders into conversations.

So here is our mission-we need to design tools to get a sense of our 
student's and teacher experience, are we being true to the essential 
attributes without conducting activities that violate these 
characteristics.  I'm asking for advice about focus groups, journals, 
surveys or other tools.

Any thoughts?  Articles?  Similar programs that serve a comprehensive need?

Have fun and check out the web site if you wish to learn more about SMILE.