BOSTnet Summer Series II

As part of BOSTnet's Summer Series, we reflect on the issues brought up in conversation or as part of the presentation. This meeting covered behavior, however, many aspects of staffing and program needs came up in group discussion. Summer is less then two weeks away. Whether the program is 5 weeks or up to 10 weeks, Summer presents certain challenges as well as opportunities - both for children and youth as well as for the program itself.

One very common aspect of summer programming is that many programs rely on this period to raise money. Some programs refer to the summer as their "cash cow" since fee-for-service is high and there are more families willing to pay. These sums often cover activities for summer and then work as a bridge fund in autumn until grants, contracts, and payments come in or a fund for the end of the academic year where funds have been spent and resources are few.

So there is an economic aspect of this service where summer subsidizes the academic year. There is another aspect where programs have to ramp up into full time services and work with children or youth who may be part of the academic year or may follow another configuration - such as several sites being consolidated into one site. This need for high enrollment as well as the reconfiguration can stress site directors as well as lead to a summer where activities are not always as organized or purposeful as as activities at the same program but during the academic calendar.

Summer is full of opportunities to grow program funds and deliver more in depth services as there is a longer day. Often this day is full of recreational activities - which are needed. However, there are often summer reading or other summer work that has been assigned by the school for completion by summer programs. Getting children and youth to work on academics was seen as a challenge as well as leading projects that made participants to resist because - and rightly so - they say "we're not in school!"

Summer programs can do learning, however, the group felt that if these activities needed to be fun and engaging - getting in field trips and special visitors. Summer time can be learning time, but a longer day does not mean longer activities. Children and youth still want to go swimming. And rightly so.

One member of the Summer Series group said that themes worked for the summer. These themes could change week by week rather than run for a month. This allows for staff to come up with activities easier as well as focusing the program on short-term goals since every week there is a "final show."

Whether summer time is catching up on school assigned reading, theme projects, or recreation, summer programs have a short span of time with their own challenges. This time is not just an expansion of the afterschool program, but has to look different - even if the staff and students are the same. Perhaps more work needs to be done in focusing this work and pulling out best practices for summer fun and learning.

BOSTnet Summer Series

The training was convened in the Boston Public Library. Participants come from all over the state of Massachusetts with a heavy representation of the city of Boston. Program range in type, age, and their focus, but all gathered to learn how to make their summer program engaging for children and youth. What is interesting is that the majority of participants have already run or been part of a summer program. So, what is new about summer?

Summer time programs are not just extensions of the school year program. They are often opportunities to do activities or create the type of learning environment that the school year time slot just does not afford. They may also be additionally challenging because staff are different and children or youth may also be there inconsistently, be new to the program or staff, and have a set idea of what they will or won't do in the summer. One pressure is on programs to perform more and have more clear goals and objectives - especially with the talk of "summer learning loss" and the need to provide children - primarily inner city or minority - with additional structured academic time. Some form of academic assistance may indeed be needed over the summer, however, summer school has been around for almost as long as there has been the public institution of school. What is difficult now is that programs thrive being fun and engaging places and do not have the desire or often capacity to transform their program from what it is today into a program that can be better managed and analysed centrally.

It seems that summer is itself almost like a project.

There is a beginning, middle, and end. The run is 8 - 10 weeks. There are learning goals. Those things that the director of the program really wants children or youth to experience or learn (from academics to social emotional skills). Then there is the final product. This can both be whatever is in the show at the end of the school year, but also the goals set by the director (perhaps with program staff) to answer the question, "what do we want children or youth to have done by summer's end?"

Now, we will go on to list all the many things we could do with children or youth over the summer. From that, we will look at creating a "doable" list that can fit on the schedule and which can be realistically done.

Summertime is a time for young people to break out of school, and take out their knowledge to solve problems or just experience the bumps, bites, and bruises of being a kid.

BOSTnet Quality Forum 2009

The Quality Forum, held at The Boston Foundation, was attended by over a hundred program staff, directors, administrators, board members, and funders. It is very telling that even with the financial crisis and all the pressure on organizations and their programs that quality matters. Not just doing the job. Beyond just "trying our best," each attendee seemed committed to making their program a quality service for the children and youth it was designed to serve.

What did this quality look like in the many diverse programs represented at the forum? It is hard to say. Outside of the forum and in many meetings leading up to it, we have heard program directors say they want more information on what children and youth need, what families think about their program, and ways to measure their impact not just for grant requirements, but to answer the questions, "how is my program doing" and "how do I know?" There are a great many program directors feeling stressed by demands for further and more in-depth assessments, reportage, and being held responsible for youth outcomes that they have little direct control over, such as in school attendance or performance. While the definitions of "quality" as a unified front continue to grow (when they do not ebb for lack of funding), staff at the program level continue to do their best to examine their programs and the needs of those they serve.

What was presented at the Quality Forum was not an attempt to promote a unified message around quality, but rather an examination of several views. The view of quality started with research. Dr. Gil Noam, Founder and Director of Program in Education, Afterschool & Resiliency (PEAR) presented a quality view that looked at programs addressing developmental needs of children and youth first and foremost in program design. Young children need different supports than older. The atmosphere of a middle school program needs to be social and active. Older youth need to choose activities and need to be motivated to attend rather than compelled or mandated. This work will soon be made more available to a wider audience but for the meantime, it shows that research is supporting the social-emotional power of out-of-school time as a unique environment for youth development.

BOSTnet presented its own research-based framework. This framework looks in depth at the environment and approach of programs. Based on BOSTnet's 21 years of work, this framework is very simple for those who have worked a long time in the field--almost too simple according to the evaluations returned. However, to those who are new to the field or those who continue to not understand the "story of out-of-school" this framework is accessible and demonstrates how the variables of the environment and the approach meet at the point of service to create a quality environment for youth. If this framework appears simple, the mechanics of making it happen are complex and take a great deal of work. The presentation and tools from the 2008 - 2009 field work were disseminated for use by other programs.

Corey Zimmerman, Director of Strategic Planning and Analysis of the Department of early Education and Care (EEC) presented the state's answer to quality through its developing system of quality improvement and program assessment that may be mandated as part of licencing requirements for school-age programs. The Quality Ratings and Improvement System (QRIS), is a "fast-spreading policy innovation because they align standards, supports to programs, and accountability efforts into one non-duplicative system." This effort appears to need a unified system to support it which the out-of-school time field has yet to develop (and often the field asks whether this should ever be developed). This innovation is perhaps useful to staff at programs but also is seen by many in the field as an unfunded mandate since some of the quality improvements don't appear to come attached to additional funding needed for staff time or other expenses. Of course, this is a work in progress, so we cannot point to the nature of the QRIS innovation nor its impact.

The final part of the day was a panel of directors. For Kids Only Afterschool (FKO) and Bird Street Community Center (BSCC) both discussed specific examples of quality in their organizations. For FKO the issue was investment in staff development and an allowance to work with staff at their particular stage in their career and educational growth. This meant a great deal of professional development where their time was paid for. This meant swing time to attend college courses or support to gain a certificate. A great deal of training was done internally so that the FKO approach was reinforced and outside trainers brought in for targeted work such as behavior or curriculum development. BSCC also invested in staff. BSCC worked hard to rais funds to increase the number of full time staff so that the positions and the work could be the primary focus of staff and the job as a career was feasible. Staff were supported internally and also provided professional development since now with the extra hours, program staff were paid for these trainings. Both these quality strategies focused on staff. Without good consistent and prepared staff, program quality would suffer. While many in the audience said their organizations could never cover the funding needed to provide such supports, it demonstrated that to achieve quality programming perhaps piecing a workforce together and expecting full time commitment at part time pay is not feasible.

In all, the Quality Forum presented a lot of information in too little time. This is also a sign of the times. Programs have reported less time to devote to outside meetings, conferences, even training. It was decided that it was better to fit in too much information - allowing learning points for everyone - rather than a brief survey of information surrounded by ample coffee breaks. Also, as another sign of the time, there was no catering budget.

We welcome further evaluation or response to our Quality Forum. There will be a more formal discussion of this event in the BOSTnet BUZZ, BOSTnet's e-newsletter.

Quality is "Job One"?

The days to the Quality Forum are short - the questions around "quality" as it relates to out-of-school time seem to grow. "Quality" is one of those terms that we hear a great many times - from corporations, from product salespeople, from former automotive giants. Whether "job one" or "continuous improvement" or "quality improvement" or other flashy catch phrases and academically or research supported systems, the question remains - what is a quality out-of-school program?

Also, built into this question is other question. Who asks for this "quality."

If "out-of-school time" is any program that works with children but is not run directly by public education employees then these program include more than "after-school" and reach into museums, summer camps, and enrichment programs - even if some part of these programs take place within the confines of a public school facility or during the hours of school and in collaboration with school teachers or officials. Out-of-school is an approach that transcends programmatic focus, mission, or population as it is a number of very diverse programs bringing ways of learning that may differ (not detract but differ) from the approach the public system is currently taking.

Perhaps, then, quality is different for different programs but can be measured if those measurements are directed to the focus of the program or the ability of staff to create the type of environment where children and youth are cared for and can learn - differently.

And who asks for quality? Yes, regulators, funders, parents, politicos, endorsers, and sundry other influences that have piled on to the backs of programs.

However, it is children and youth that ask for this. True, no seven year old will say, "can I have a quality program and how are you going to assess this so that I know both empirically and based on research drawn from data that was appropriately cleaned and triangulated that my youth outcomes improve based on my attendance" - which seems what many are asking site coordinators and program directors - but "What am I doing today?"

That's at the center of quality, a child or youth asking - "what am I doing today?" Right now, in the moment.

Our job is to make that "doing" fun, engaging, learning, positive, supportive, and safe.

Each one of these elements may be measured in great detail - what is "fun" how do we know when we are having "fun" - however, is that appropriate for a field where the work is not to answer philosophical conundrums but to provide a point-of-service.

How about measuring:

Children or youth participation by attendance of program
What days do children or youth come? When are they picked up? How much of the year or season do they stay? Do they also use the program for other times of the year?

Children or youth return rates
Do children and youth keep coming back?

Parent or family involvement
Do parents pick their children up early? Do they attend events or assist in the program?

Staff retention
Do staff work the duration of the program? Do they return again to work another season or year? When they leave, do they continue to work in a similar position or move on to a higher position?

Children or youth satisfaction
What do they say about the program? Do they feel stuck there or can't wait to attend?

Perhaps by focusing on measurements that are obtainable by programs, meaningful data can be gathered and program quality can be assessed not by a multitude of indicators, but by a finite number of contact points that can span programmatic type, approach, and environment.

Learning in Out-of-School

Project-based learning has been around for a long time. Many of the early progressive educators were indeed doing projects. The educational philosopher John Dewey was looking to make learning more real than the factory-style learning he saw about him. In the decades since, there has been innovation in teaching and learning inside and outside of the classroom.

Today, there are student centered classrooms, reading corners, rocking chairs, and carpet areas and many other innovative strategies and frameworks being used inside the school day. There is still a great deal of traditional structure and those who see a further erosion of free time, recreation, and creative problem solving in the school day. There is a great deal of pressure on schools. They are asked to carry many of the traditional roles assigned to parents, and yet, teach a specific body of information and create a common culture. With schools mandated to have delivered outcomes for every hour of the day, cannot out-of-school programs assist by creating a different learning environment not to augment the school-day tasks, or in opposition to the learning styles of traditional education, but to create that social-emotional playground where children and youth can learn by hands-on activities and the socialization that contextualizes all understanding?

Project-based learning in out-of-school is not just about dissecting eels, improving the process of making clay dough, or creating a model of the neighborhood to understand the importance of places, it is also about the process. A time to see what others know, understand how actions impact the group as well as to take individual initiative. The papier-Mâché float, or the community map, or the fundraiser run by the children and youth is not always the largest, or finished on time, or as grand as the original plans, and the outcomes cannot always fit the metrics of the school day. Nevertheless, when the framework is clear, when adult staff are energized about leading projects that dig into a topic over roughly connected activities (theme activities, arts and crafts without context, etc) there is a learning environment that can reach out to children and youth and really dig into the benefits of out-of-school time as a place of social contact and deeper learning.

At a recent training, a group of group leaders were learning how to become project specialist. Being a project specialist means not just leading fun activities, but sequencing activities to answer or explore big questions and fun and engaging topics. The group was led on a simple activity. Make pasta drawings. Everyone seems to have remembered what this meant. Some asked questions about whether they could draw lines first, plan, or what the picture was to be about. They were told that they could do this activity any way they wanted. They were even provided tooth picks to add into their pasta drawings if they wanted. After a short period of time, the group was gathered together. They were told to get up and look at other tables, look at other works, and if need be, make constructive comments. When they were sitting, the group was asked - was this a project.

The unanimous opinion was "yes." It was hands-on, it was an open ended activity, they shared the materials and showed each other what they made. However, what was the deeper learning? "We learned to work together" one staff member said. However, did they now know that before the start of the activity? It may be that it reinforced what they knew, which is not a bad thing, but what new learning did it lead to? Also, did the product they made matter. "No. I'm going to throw it out as soon as we leave." This is similar to how many children respond to the things they are asked to make in out-of-school. The "done and dump" outcome.

The group was then led through what project elements were in the activity but how that activity did not reach as far as we can go in out-of-school - even though it was a fun activity in-of-itself.

The day before at the training one project example given was zombies.

Yes, zombies.

The group revisited that topic - used as a comical example that this group of adult learners - because it spoke to them. "Zombies" then became the focus of our project simulation, even if it was not a child-ready topic. It was engaging for the adults, therefore, they could better see the process and experience some of that fun in learning and exploring we hope children and youth will engage in but which many staff cannot find then discussing clay modeling as if they were themselves children. The group discussed what they would make in a zombie project. The title selected was "Zombie Attack." The final product an escape plan. The group talked and discussed what they needed to learn. "What do zombies eat," "why are they here," "are they fast or slow." The group put down some of those questions as well as "how do we work together" an then looked at the project. The group made a list of things they could do as activities as well as resources. When this was done, they again looked at the learning goals. Were some of those questions short-lived or limited? They asked larger questions which would naturally capture smaller fact-based questions. "What do we need to know about zombies?" was the first learning goal, collecting the other zombie fact questions into one bucket. The next was "what do we need to survive?" This question is not just about zombies, but can be taken as "what do we bring" or at a deeper level "what are the basics of life or things that are important to us?" The Third question was "how do we make a plan?" This came up because the group was divided between where to go (Home Depot or Walmart) and how to get there (run as a group, everyone for themselves, cars, etc). This also meant we needed to revise the "how do we work together" to "How do we help each other survive?" A deeper question and one that goes into community at a much deeper level.

With these questions, we looked at the activities and revised several based on what we could do (simple materials or low schedule impact) and what would take more funds than we wanted to use (e.g. renting a helicopter and getting MTV to film out process). There could be research (zombie movies, books, common lore, internet sites), discussion (debate, shared experience, etc), and field trips (trip to Home Depot, Walmart, looking at the building for how to defend or escape from it). To show how this was done, the group actually was charged with leaving the building simulating a zombie attack. After much discussion, the group did not choose a leader, and when time was called two groups formed and left from two different directions. The escape was hampered by confusion. When we regrouped everyone was sure they would be the survivor, but others would succumb to the zombie hordes. The group then discussed the experience. We were no longer talking about escape and planning, we lived an experience and could see first hand the flaws in our planning ability, our need for leadership or shared decision making, and a need to learn how to help others survive. This comical example was fun, and that is also central to the project. At the end of this process, we could all see that as adults we'd love to do a zombie project - and with children and youth we can see that we want to go deeper into questions and use sequenced activities that get children and youth to move, to laugh, to bring in their own knowledge and to experience something they may not do on their own.

There will be other trainings and who knows what topics will be used as an example. With practice, it seems that this group of learners will now be project leaders and while perhaps avoiding the entire topic of zombies, create fun projects that matter.

Learn more about project-based learning for out-of-school time at www.bostnet.org

Summer Is Here, Again

Summer is here and city children will soon be spotted wearing agency tee shirts and filling parks and recreational places. Other children will be enrolled in arts camps, band camps, and other camps where the tee shirt is optional or non-extant. Leaders will again discuss key issues about where children and youth go for the summer and what they should be engaged in. There is a great deal of discussion on "summer learning loss" and how summer programs geared towards academics can prevent this loss from occurring. These discussions are generally aimed at urban children and youth, since the data suggests the loss is greatest in urban minority populations. That there is a loss over the summer for children may be true for all children but the effects of this impact those who struggle the most at school or have language or cultural barriers. What to do about this, is less clear.

It may be that all children benefit from great activities that make them think, meet new friends or engage with others in structured an unstructured ways. It would be a shame if inner-city children get a version of summer school while others get:

Trips to a zoo or visits by a nature program
Getting away to a camp for the day or a sleep away
Engaging in a project that involves trips to museums or cultural centers
Cleaning up a neighborhood park or other service projects
Sports programs and athletics

It seems that there is a great deal of discussion between those who want to see summer as an extension of the school process - think "summer school" and those who want to see youth be active in recreation - the "send this kid to camp" tradition. There are those who are looking to meld the two into a hybrid form where children and youth learn formal topics but do so in a more active and participatory learning format. There are many programs that already do participatory learning, however, the press is filled with more conversations about childrens' "time" or following "youth outcomes" (these more than not include events outside the control of the out-of-school program like attendance in school over attendance in the program) or looking at links to this or that curriculum.

Again, summer is here. Children are growing, their minds changing and the road to adulthood is set according to a calendar. We seem to know we want to do something positive with our kids, but as in summers past, we may not agree on what this positive thing looks like.

Communication and Out-of-School Time

"Communication is key," we are always told. The Not-For-Profit field, and especially Out-of-School Time (including from early care through youth work), relies on "relationship building" and often those relationships are built over time and use a great deal of resources to manage. Site visits, meetings, cohorts, conferences, phone conferences, trainings, forums, mailings, events, and other point of organizational and professional contact take time and money. Recently, much of that money has evaporated. Increasingly (or is it immediately?) dollars are put to point-of-service and skipping over entire networks that have been grown or maintained over the past decade. Of course point-of-service money is needed, however, the infrastructure that was being assembled or had already been in place is also needed. The communications infrastructure of point-of-contact needed to maintain quality programs, a broad base of stakeholders, and professional development. Some of these points-of-contact may be provided by digital media.

Digital communications are not just communicating to funders, but looking at technology to reinvent how non-for-profits engage their stake holders as well as the fluidity that Out-of-School Time programs need to respond to as they meld their program or organizational message with the real-life cultures of the populations they serve. This is perhaps especially challenging for youth-serving organizations since the culture of youths are..... often incongruous with the culture of an organization, especially older mission driven organizations used to the brick and mortar one way control that print media allowed. Youth culture is garish, often filled with crude media images, commercialization and and now able to be uploaded to Youtube and linked to your organization at the click of a button. Scary stuff for staff used to well managed community bulletin boards or quarterly newsletters filled with passe clip art.

The change in communications does not just swap paper and ink for bites of information and blocks of color on a screen, it alters how information is created, consumed, and reinvented. The best example is how bloggers have eroded the traditional news media especially print. It is not just the Boston Globe feeling the burn, it is story after story being broken or covered by bloggers long before reporters with advanced degrees in journalism and years of experience ever get it off the wire. To communicate today is to do so faster, but also giving up a great deal of control over how content is used - or abused. There are risks to this move beyond the traditional fears of Out-of-School Time professions that youth served online may be connected to dangerous elements in society (time and again studies show youth to be more savvy on the WWW. than adults give them credit for). There is an unfamiliar feel to the way an organization has to expose more of itself as well as understand that associations will have to have increased management as well as more awareness by funders that they are seeing a fuller spectrum of who organizations serve and the connections they make - whether the organization enjoys that connection or not.

At the Roundtable a number of leaders and a handful of direct staff attended. It was telling that few direct service staff attended and that some who RSVPed were actually removed from the list by their supervisor. It is interesting to see that the more progressive programs saw all their staff as included in message creation and communication while the traditional organizations continue to think in terms of media marketing and message control - similar to how print has resisted digital and still does not know how to respond (outside of several newspapers shuttering their operations). This may be more of a style issue with organizations, with some able to support a common message while other more grassroots organizations allowing for a faster and looser control and more user generated/ staff generated content. It is hard to say which way is "correct" or whether both are appropriate for their audiences and typology of program.

Several organizations presented their work in communications to give some ideas about how to use the services out there as well as some challenges. Massachusetts Afterschool Partnership presented their MAP Facebook fansite work, while Boston Afterschool and Beyond discussed both the search features created by the BostonNavigator project as well as new work in using digital tracking to monitor youth using social services within the city. Teen Empowerment discussed their Teen Empowerment Youtube Channel and how this is used both by their youth as well as how more professional products are created and shared with funders. The Boston Children's Museum shared their free on-line curriculum especially made for and field tested by Out-of-School educators as well as highlighting that this work may expand - but will always remain free to the educators who need it. What is an interesting link between all these initiatives is that the users - viewer or whatever the new word may be - is not charged. The communication is not to create content that is paid for at the point-of-contact and this is in keeping with the spirit of the internet and new media as well as the challenge to the digital age - how do we pay for all these services?

Of those who RSVP'ed a very unscientific survey was taken using Survey Monkey. It showed that although Facebook and Linkedin use is high, few other communication services are used. This means that perhaps these services are not fitting to the organizations or perhaps the field, but also it may suggest that there is an opportunity for growth in Out-of-School Time communications.

Support Your Blog By Commenting

The concept of academic freedom has not always existed. In theory, perhaps since the first teaching institutions, but in practice here in the United States it did not take hold until 1940 in the Statement of Principles on Academic Freedom and Tenure. This document was authored not by the state, but jointly authored by the American Association of University Professors, a membership organization founded in 1915 to give voice to the developing field of university professors that was under stress from conservative college and university boards and funders. The issue that created this organization, migrant workers rights in the classroom led to a professor being fired.

Out-of-School may be very different work, but we need a free voice in developing our practices and the ability to promote what is unique about our work. Many programs are seen by the mainstream as disposable additions to the day of children and youth. Arts, sports, enrichment through hands on activities, social emotional development, are often seen as "soft skills" or done by "wide eyed 21 year olds" (personal communication, 2008) who lack classroom management when what Out-of-School Time workers are trying to create is not a classroom but a learning community.

This blog has been an experiment in such academic freedom - a developing voice to stimulate ideas and to demonstrate that the Out-of-School field is a growing area that offers children and youth opportunities they cannot get anywhere else.

We'd like to hear that this experiment has merit. In the past three months there have been over 350 readers from Massachusetts, across the United States, all countries in South America, and one reader in Africa. This is exciting that our local work can have such an impact. We invite readers to comment or e-mail a few words of support or concern so we can better assess this endeavor.

Thanks

The BOSTnet Roundtable Year in Review

2008/2009 Leadership Roundtable Series Reflection

Overview
For fourteen years, BOSTnet’s Leadership Roundtables have been one of the many professional development services we provide to the out-of-school time (OST) field. They are a key activity in our approach to quality improvement that focuses on building staff skills around identified field competencies. This past year, we updated the format and began holding Roundtables in communities outside of Greater Boston that have limited networking and professional development opportunities. In the past the Roundtable relied on panel discussions in which participants discussed effective practices used in their programs. This season’s offerings combined networking opportunities with research-based training presentations and collegiate conversations to foster a more inclusive learning community. Training topics were sequenced to build a body of core knowledge and to meet the needs of program staff for professional development credits through the Department of Early Education and Care. Thanks to the generous support of For Kids Only After School, Inc., BOSTnet re-launched the Leadership Roundtable on the North Shore while the Shapiro Foundation, the Boston Foundation, State Street, and others provided support for the Boston series to continue into its fourteenth year.

Review of Activities
The sequencing of events was an original concept. It has long been recognized that staff at OST programs experience turnover during or after the summer and there is a need for refresher materials at the beginning of the academic year with older staff in new positions or assuming new program projects. To address this need to orientate OST staff (including directors, coordinators, and new staff), BOSTnet launched the fall series with Quality Environments for Youth, an overview of what makes OST programs a unique developmental setting for youth, how it differs from formal education environments, and its potential as the primary pathway to healthy youth development. This environmental approach to building quality programs represents BOSTnet’s view of the field as a complimentary support for children and youth from what they receive during the school day.
The series continued with Promoting Positive Behavior, purposely front-loaded at the beginning of the academic year to address behavioral and group management issues as programs are assembling. Behavioral support training is consistently one of most requested and well-attended trainings we offer. As the year continued, Project-Based Learning provided a working structure for programs to intentionally frame enrichment activities, meet academic standards, and allow program staff to develop their own fun and engaging projects. The beginning of the Spring Series we had the opportunity to dig down into more complex issues that are a perpetual challenge for providers, including accountability and inclusion. To help support programs faced with shifting expectations and increasingly complex requirements, BOSTnet surveyed the many different tools for measuring program quality and provided a forum for programs to discuss some current issues they are facing in obtaining meaningful data. Inclusion also raised many questions for programs that are seeing many disabilities manifest as behavioral challenges – especially as the definition of disability is shifting to include social-emotional or cognitive disorders. The final Roundtable in the 2008–2009 series set for May 7th, Effective OST Communication in a Digital Age, will discuss program communication, outreach, and new web-based technology.

The presentations provided built upon the knowledge we have gained over the past few years running the Lead to Opportunities for Youth with Disabilities (LOYD), Promoting Positive Behavior, Engaging Families, the Facilities Initiatives, as well as best practices gathered from BOSTnet’s fieldwork. Leadership Roundtables on the North Shore were hosted by different organizations such as Girls Inc., the YMCA of Greater Lynn, Boys and Girls Club of Salem, Community Teamwork, Inc., and the North Shore Community College department of Education who also generously provided refreshments. The Boston Public Library where wireless Internet allowed for “real time” web searches and video feeds hosted Boston Roundtables. Every roundtable was evaluated and reflected upon on the day of the event, elevating key issues and capturing quotes and conversations, while providing transparency as to effectiveness and participant satisfaction. Reflections were posted on the BOSTnet blog at www.bostnet.blogspot.com and indexed according to topic or initiative. Comments were welcome to these pages by interested parties and attendees, allowing for anonymous comments to create a higher level of academic freedom and dialogue in the field. Research support was provided by Michael Bennett Monica Zgola handled logistics. Evaluations were developed and reviewed by Manosi Datta.

Observations
Over the past year we have connected to many great programs and staff and heard inspiring stories from staff that are working hard to make a difference in the lives of children and youth. Nearly 500 attendees participated in the 2008/2009 Leadership Roundtables in Boston and the North Shore. The level of experience of attendees was on average ten years or more in the field. Some commented that they felt most professional development was not raising their abilities but “refreshing” strategies or approaches they already felt confident they knew. There was also consistent representation by “line staff” however; this was more the case for Boston than the North Shore.

Programs are stressed by shifting and increasingly unrealistic expectations, inconsistent directions set by funders and policy makers, and, of course, the economy. Many see a diminishing of the community they found in the OST movement, and are interested in continuing to network and share ideas. A major obstacle to this is the limited funding strategies available to programs that creates a more competitive environment and less cohesion in the movement. Many current leaders (many attendees over 20 years in the field) wonder about the upcoming leaders that are needed to keep the field growing and strong. Response to the Leadership Roundtables was positive, as evidenced by solid attendance, increases in blog readership, and positive reviews collected in evaluations. With fewer professional development dollars available and increasing professional development requirements for licensed programs, many providers see BOSTnet’s Roundtables as their primary staff-training option. We will continue to use participant’s feedback to improve our offerings to better serve the field. A few of the suggestions we are currently evaluating include providing specific Roundtables for different level staff, and providing more afternoon trainings for direct staff when they have paid program time.

The Coming Year
We are currently working with partners to plan the upcoming series and expand the Roundtables in the South Shore and Central Massachusetts for the 2009/2010-year. As BOSTnet assumes its role as the Massachusetts’ affiliate for the National Afterschool Association, some changes may be made to both the delivery and geographic reach of our Roundtables. We are constantly developing new topics and refining old ones based on lessons learned from our fieldwork and research. In collaboration with the DEEC, Roundtables will be evaluated according to standard expectations of training organizations and other entities may be involved in delivering these events or informing the content. Funding for these events may be provided by organizations acting in unison, as was demonstrated by organizations on the North Shore this past year, or assistance may come from private or governmental channels as has traditionally supported the Boston series. The series topics with locations and hours will be listed on www.bostnet.org.

Technology and Out-of-School Time

There is a great deal of information out there through various media. We hear about newspapers being shuttered while also the ascendancy of new forms of communication that not only replace the paper format, but redefine how we communicate and construct knowledge.

That is not to say that the only thing we are constructing is knowledge. There is a great deal of clutter and with each advancement in communication, there seems to be an equal advancement in people's ability to turn something good into yet another stream of trash. The academic papers and open discussions of the Internet became chat rooms and.... pictures of questionable taste. E-mail became SPAM. Viral ideas, became viruses and Trojans or other malware. "Maleware" became a word.

Some react to these forces with a heightened sense of danger. Filter, restrict, create hoops to gain privilege to the network - and this is program staff not an attitude to children or youth. Others have taken the everything new is a new opportunity and jumped further and further to the "bleeding edge" (beyond the "cutting edge" for those of you old enough to remember proper grammar). Some organizations have unloaded millions of hard-raised dollars for web pages, search features, and Java script and encouraged others to "join the digital age." However, the non-profit sector in general and Out-of-School Time in particular seem to have not found a way to raise themselves above the clatter, hold on to a certain amount of control while realizing that new-technology redefines host and user content and may offer a more transparent window into their work - whether they like what outsiders are seeing or not.

Out-of-School programs are slowly coming into the digital age - as are training providers, OST researchers, and other supporting institutions as organizations jump in often using models applied by the corporate world or from personal experience (the hey, I use myspace with my friends so....). This topic will be explored at an upcoming Boston Roundtable organized by BOSTnet Thursday May 7th from 9:30 - 12PM at the Boston Public Library. If you would like to discuss what you do to promote your organization, meet funder needs, or integrate technology into what you bring to children and youth, please attend and be prepared to visit your website and tell others about how this or that aspect of technology captures an audience - or you feel drives away community.

Over ten years after the dot-com bubble/boom/bust, we continue to ask ourselves, is Twitter really going to help us? and then Twitter that exact message so our friends all know what we're doing now is wondering.

For more information on the May 7th Boston Leadership Roundtable or to participate go to www.bostnet.org.

Behavior in Out-of-School Time

Reflecting on a number of trainings on Promoting Positive Behavior, BOSTnet's approach to behavior in OST, there has been a number of trainees from all program levels who have asked, "what's up with kids today?"

It seems that many in the field claim that there has been a shift in difficult behaviors in the past five or ten years making them question what is happening with children these days and how can programs respond.

"I used to be able to call a parent," one site coordinator said, "[children] are like... go head, call my house I don't care!" Another training had people wondering whether there were more difficult children being placed in OST for a number of reasons (vouchers being given to children with special needs - many of these needs disabilities with a high behavioral component) or whether there was a change in how children act and how parents are raising their kids. These comments perhaps can be dismissed as an aging workforce looking to the past with nostalgia or getting weary of the repeating behaviors year after year as different children express challenging behaviors. It may also be that the supports - a challenge/strategy approach - is not able to address the issues since there are so many factors that make each individual situation different. A child likes to lick other children. This child seems to have a developmental issue that is not diagnosed. The staff have talked to the parent, met with teachers, reinforce positive behavior at the program, but still, Sally licks other children. "We've done so many interventions" the staff say. Now what? Listening to many staff talk about their solutions there were some situations that have been so complex that there is no "out of the box" solution (such as in a case where the strategy is clear but there is no staff available to follow this strategy because it takes time that the already stretched program does not have - how at a training can the trainer invent more time?). Perhaps this is because much of the materials for behavior are borrowed and "adapted" for out of school but they retain much of their original more formal approach to a youth environment - that of the day school. Is OST behavior different? Screaming and punching, no, that is still an issue, but is there a scope of acceptable noise and movement that may appear more messy? "I look for a healthy noise" one director remarked.

Another issue is that program staff want to create a different kind of relationship in their program between children and between staff and children. This is marked by informality, active discussion, and relying on strong relationships to promote a positive environment for youth. Many issues staff have with behavior seem to stem from their having to switch back and forth from caring adult to trying to recreate a classroom environment. With more programs working in school facilities or partnering with schools, what are the dynamics of being known as "Sue" inside the OST program room but "Ms. Watson" with the same children but in the hallway? There are challenges in maintaining each relationship - and perhaps many staff seeing even greater difficulty in achieving both.

Behavior support is one of the most popular BOSTnet trainings and consistently the highest attended Roundtable (in all locations). Some trainers have joked that they can make any training popular just by throwing in the word "behavior." In a previous post on BOSTnet's Inclusion Roundtable was the reflection that in the discussion on Inclusion, the issues raised was not so much how to include children of all needs but "what do I do with Johnny who throws things does not listen and may have ADD ADHD learning disabilities and has not been diagnosed and we are not provided the one-on-one he gets in school."

As programs are preparing to be judged or rated by various systems or departments, how can behavior be approached in a way where the apparent chaos may not be, in the context of an approach developed specifically for OST, anything other than positive noise?

Program Profiles on Youtube

As part of BOSTnet's on-going series of on-line program profiles, KidsArts! was featured. A program that was founded by families almost two decades ago to provide arts education and child care, KidsArts! is currently operating in the recreational area of an historic church in Jamaica Plain. The program has an arts focus, but at the center of this program is building a community of learners and taking care of children. The staff are all artists who are trained to provide educational enrichment and act as teachers. The program takes in children from many schools as well as children who are home schooled. This program is an example of a small scale independent program that fills an important role in the community and may represent the kind of program that appears to have a high level of quality, but that quality may look very different to a more standardized approach. That the program has lasted almost two decades (with one staff member there from the beginning of the program) demonstrates that individual community-based solutions are not necessarily temporary situations depending on a certain group of parents or a limited scope of activities. While KidsArts! may have been created to fill a void left by the cuts in arts funding and programming in the day school so many years ago, the program is no longer about the deficits of formal educational programming. KidsArts! today provides parents of different economics as well as parenting strategies a vibrant learning community for their children. There may be hundreds of similar programs throughout the Commonwealth that do similar work.

LOYD: Boston Inclusion Roundtable

The BOSTnet Inclusion Roundtable brought together a small number of program directors, direct care staff, and Inclusion specialists. The presentation initiated a great deal of conversation around the sorts of supports that Out-of-School Time can offer children and youth with disabilities and the need for increased funding of staff development to ensure that programs can provide a quality environment.

What was interesting was that unlike the last roundtable, this group did not say that they lacked the same supports as the school day because they questioned the supports of the school day itself. One support was the "one-to-one aide." It is common to hear many Out-of-School professionals mention that children they include in their programs are done so without the support of these aides and this reduces the quality of their program both for the individual who requires the support by day and for the other program participants. At the Roundtable, many questioned whether the aide model was good for the child in school or whether it set that child apart and allowed teachers and students to remove themselves from care-giving. One OST program staff said that it was a good thing that they did not have aides and that these children who were provided aides or sent to special programs within the school for the majority of the academic day were included in an authentic way during their program time (some mentioned that severe mobility impairment or intense mental or cognitive disabilities that lead to aggressive behavior may need additional supports). This was an interesting to hear since it is very common to hear lists of program challenges around Inclusion rather than a confident point of view that said "schools should learn from us about what we do" rather than "we are deficient in this area without funding."

There was a great deal of talk about how many schools continue to exclude children and youth with disabilities - and that these programs while they may not take place during the entire day are often in re-purposed areas of the school facility; basements, former bathrooms, former closets, former mechanical rooms. While many said that their programs operated in less-than-optimal facility environments, many programs felt that their program did a better job of including children or youth with special needs so that the physical space did not move these members of the community "out of sight." Some of the attendees had personal experiences with the Special Education system and spoke directly of being in a "closet classroom." One staff member said that he was diagnosed with a learning disability while the school support staff never questioned why he had missed so much school in the previous years. So the issue treated was the inability to read "on grade level" not the social issue of truancy. He claimed that this experience of being in Special Education classes increased his difficulties with school rather than elevating them - the primary reason being social/emotional not whether the mechanics of reading were being taught in a different way. His ability to be excepted by peers was impacted as well as self esteem. Another attendee picked up this thread and asked how it was that schools seem to teach exclusion during the day and then leave it to programs to "un-teach" what they have done. "We have to much to do in just a few short hours... We got to show them a different point of view than their school... maybe their family... has on children with special needs" a staff from an arts program exclaimed. "Well, all children have special needs" another staff chimed in. "We have to see that the modifications we make benefit all the children in the program.... I mean, we do this for everyone, not to accommodate only a few."

In all, the Roundtable only briefly touched on the formal presentation. One highlight of the presentation was a short discussion of Dr. Gary Siperstein's work on Inclusion and his thoughts that Out-of-School Time programs actually are bridging the social barriers between children of different abilities and do so because the environments of these programs are focused on relationships first, activities second, and have a flexibility that many formal settings do not have (one example was a program that was in an old building so that mobility impaired children could only attend the basement. The program did not have money to get in an elevator, so they moved the most popular activities - media and computers - to the basement. This created a situation where youth who wanted to access the resources needed to confront the Inclusive nature of the program. One girl was so unfamiliar with interacting with others in wheelchairs that she refused to come in but would stand at the door. By having discussions and allowing interactions to grow organically, this child finally entered the room and got rid of her fears while the program developed a culture of Inclusion that remains to today).

It appears that while there remain challenges (especially around having funding for quality professional development) there is perhaps an emerging attitude of many program staff that they are able to provide a very high quality of service - even if that service does not look like solutions provided during the school-day. While research and the voices from the field tell us that Out-of-School Time is providing Inclusive environments, these programs in the room felt that they were not recognized for the work that they did or the successes they were having.

Quality Forum Countdown

There is a great deal of discussion in school-age programs around the new quality ratings system being devised by the EEC as there is about new EEC regulations and for many in the Out-of-School Time field, a larger discussion on quality of service and how best to measure unique contributions to youth development that these environments offer.

BOSTnet is planning a Quality Half-Day Forum and will attempt to bring together some of the current issues as well as examples of quality programs in a range of program types. This forum will soon be looking for presenters and identifying programs that can serve as an example of quality in action.

It is hoped that this forum covers a ranger of issues as well as providing concrete examples and tools or resources around how to improve quality at the point of service and some of the challenges in meeting larger system improvements. The Forum will contribute to the discussion on program quality at a time when more people are asking how much funding is needed to support quality programs.

The Quality Forum may touch on subjects such as supervision, retention and staff recruitment, STEM in Out-of-School Time, and other issues of quality such as the QRIS.

BOSTnet is looking for input from the field and welcomes thoughts or advice on what subjects are currently being sought and what resources may be the most useful to the field.

More information on the Forum can be found here or at www.bostnet.org

Diversity of Children - Diversity of Programs?

What is a quality program? Can there be a single definition of quality for all programs, or does it depend on what a program offers (childcare, arts, sport, academics, socialization, etc.) and the children and youth it serves? We hear time and again that children and youth have diverse needs. If there are different programs, approaches, and environments are there also different standards that need to be applied? Over the past several years, it seems that the public educational system has been searching to become more uniform in approach and measurement. These are but one environment, however. What measurement is given to parochial schools, or the different private schools that espouse every shade of educational approach from the most radical progressive education to the most structured curriculum. How are these measured, or, because they are not "public" - that is run by the government - these other "publics" need not be considered because they fall outside the keen of observation, even if the children and youth of those systems are part of our main-stream American society. What are their quality environments. Considering Out-of-School, will there appear a similar system of quality following the two realms of those programs receiving public - that is government either state or federal - money and another public that uses strictly private funds and is not recognized nor beholden to the standards that are developed. It can be considered that this second group, like the confederation of private schools (these need not be exclusive of rich but may be lower and middle class), be another world?

These questions are part policy, yet belong in a conversation about quality at the point of service because that is where structures and budget expectations come into play with expectations. If all children must do all things, or allowing children to self-select, creates a different set of challenges. It may impact behavior and interactions between staff and child. If certain programs have to align while others opt out through different methods (or programs say they are aligning but find clever ways to go around formal expectations), what does that mean for the quality of experience for the children and youth? This is not to propose any one way has been shown to be better than another.

However, when Johnny hates art but must do it because that is what the program expects of all kids... Does that recognize and meet the needs of the diversity of children and youth? Seeking quality and having standards need not be mutually exclusive. Identifying which standards measure what environment may be important, not just in theory, but impacting the point of service where a child meets the program.

LOYD: Inclusion Roundtable

"There seems to be a growing number of kids with special needs" one program coordinator says. "In the [years] I have worked here, I don't know what it is... they just seem to need more and more." What do you do when all your kids have special needs? One site director reported that in the same program were children presenting ADD, OCD, PTSD, and Spectrum Disorders. Another program director asked whether how to practice inclusion when what seems to work is to remove the child from time to time. "If they're not included in gym, then what? If they are just put on the computer because that's the only way not to cause trouble... are we doing a service just babysitting?" What if the funding has remained flat (or vanished) while the needs increased as well as higher standards of quality. These questions are far above the old format of Inclusion that were challenges are posed and then strategies are employed. When people know several strategies but are overwhelmed, what then? "How do typical kids fit in when many children have challenges"

It appears from comments at the Roundtable that Inclusion is still part of the wealth of services that Out-of-School Time programs can provide and researchers such as Gary Siperstein of the Center for Social Development and Education claim that many school environments can learn from the success of Inclusion in Out-of-School. This is in keeping with the strong relationship-base within many programs and the flexibility that programs have in creating activities that instruct about life as well as socialize. Out-of-School staff want an open environment. They want to make accommodations as well as many at the Roundtable knew the basics about most disabilities and some had worked in therapeutic Out-of-School programs for years. There was a healthy feeling of "try and try again" in letting kids come to the program as who they were and to move them into forming new relationships with their peers as well as push out into new experiences. Nevertheless, there was frustration as it seems that many directors are beyond the "basics" of inclusion and are ready for the next level - a level of complexity that no longer allows for solutions on the cheep but a more thoughtful approach and consistent high-level supports to staff and understand the limits of Inclusion.

One limit would be over-representation of children and youth with special needs within a program. The other limit may be resources. A program that takes in a child or youth who otherwise has a one-on-one during the day may not be able to absorb that child or youth. Programs themselves need to have policies in place that structure how program directors can communicate to families the benefits of including their child in the program as well as some of the limitations. However, if there is a language barrier or family members are opposed to discussing a perceived condition, what then? When a parent demands that their child is included but not with a realistic timeframe or perhaps without taking into consideration the needs of other children or youth at the program, what then? A child with Autism may not be able to run into the program and be included in the first day, or three weeks, but may need time as well as the right amounts of inputs from staff. Too much and the staff forces relationships - too little and there is risk of a benign neglect. This time to negotiate with one family or parent may be available, but what if there are a majority of parents and families with similar demands but divergent issues. Again, the "all or nothing" approach to Inclusion may put ideology over practicality.

One interesting observation from this discussion and the many questions was that the majority of issues were with emotional or emotional disabilities. In an on-line survey of participants 82% wanted assistance on children and youth with ADD/ADHD. Emotional disabilities came in second at 73% and trailing that was working with children with undiagnosed disabilities at 55%. Amongst the "traditional" disabilities such as mobility, cognitive only 9% felt they needed support in those areas.

Programs are asking for increased assistance in providing quality training to staff (78%) and assistance in funding to pay for additional services (82%). This later one is such a complex subject it will be addressed in another posting at a later date.

There is good news and many free resources on-line. BOSTnet has some resources available on Inclusion that may help in training staff and funding opportunities are always included in the BUZZ and the website. Resources on the website are divided into different areas, the most predominant being sports and arts inclusion. These areas were central to a series of BOSTnet events in previous years under the LOYD initiative. The idea that sports (physical activity) and arts can serve as a way to include more children and youth with special needs and that these not form the basis of the program but can be engaged as needed. These areas are useful no matter what the program's own content is - such as academics, because with the flexibility that programs have, setting up time to work on an arts project or engage in physical activity may serve to get children to work together. BOSTnet is also working on the 5th All Means All Conference for 2009 which will be shaped in part by conversations in the field.

While there was a good deal of information covered in the presentation, this Roundtable seems to have raised more complex questions than answered them. We hope that we can work on these issues and find solutions that reinvigorate the field to reach out to children and youth with special needs and not be overwhelmed.

STEM in Out-of-School Time

The second training completed by the Museum of Science at the EEC, a small group of out-of-school workers from Greater Boston looked ahead to leading interesting engineering projects using the museum's original curriculum. This is an example of what some may call a new "collaboration" in learning and not just linking school to out-of-school by way of traditional classroom academics, but using out-of-school time for different ways to access learning. STEM as it was taught, was but another way of looking at project-based learning, a framework that has been around in different manifestations since the start of progressive education and has often been refined to fit the needs of out-of-school programs.

With project-based learning, programs can sequence activities in a way that they retain the "teachable moments" but are not tied to consistent attendance or the resource infrastructure (both human and program materials) to make out-of-school appear like school. The more the out-of-school attempts this duplication the more the question is raised as to whether larger dose of the same product will improve results (it may) or whether diverse experiences are beneficial (people usually say "diversity" but then work very hard to create seamless days - even if they have to stretch the meaning of "seamless" to fit the many disconnects and inconsistencies that exist between environments).

STEM participating programs will move ahead with the curriculum on an adventure and challenge. In the coming months BOSTnet will visit these programs and collect information and observations to examine ways that STEM concepts can be taught not only in participating programs but among a wider out-of-school audience. With so many calls to create an "evolution and revolution in schools" the work of out-of-school educators may be changing and the age of "Youth Development" may be indeed ushered out as more non-profits working with children are asked by government and private funders to "rethink how you do business" and by extension what services children get and how learning is done outside of the traditional school day.

Quality and Accountability - and then there is what you do each day for the kids

When the question was posed to a room of out-of-school program directors, site-based coordinators, researchers, graduate students, and direct-care workers as to what is the intended outcome of their program, the room fell silent.

There was that uncomfortable pause - the one that if cut short would produce cut-and-paste answers, but if held too long, would cause a meltdown in energy and perhaps get participants of the Boston Roundtable heading prematurely for the door.

Then one voice spoke up. "We want to hear kids laugh. We want them to have fun." Then the answers came more easily. "We want to hear that our kids feel self-esteem and make healthy choices outside our program." "We want kids to ask whether the program is running on days it isn't." "I don't want to write kids up [behavior reports]." The entrance to the conversation on evaluation and outcomes in Out-of-School Time was about what people saw at their programs and a sense of what they knew was good for children. This was both something that occurred at their point-of-service as well as beyond their direct control. It was, however, in contrast to the many benchmarks that are increasingly being set for programs linking them to various outcomes and creating an increasing amount of assessment burden on staff already handing the daily tasks of care and enrichment in the face of dwindling resources.

The presentation on tools covered only a certain amount of evaluations and assessments. Some of these "assessments" were actually evaluations (were monitors for program quality or accountability) while other "evaluations" were actually assessments (focused on child outcomes over program competencies). There was discussion about what tools were mandated by which funder or agency and whether certain tools were still required or were about to be phased out in light of new regulations from the Department of Early Education and Care or increasing interest in ELT by the Department of Elementary and Secondary Education (formerly the DOE). This confusion was indicative of the issues of quality ratings system development and the increasing confusion - even cynical burn-out - of many in the field who look for answers and find a multitude of shifting concerns. Many in the group asked who was going to advocate for them in the face of these changes in funding and the increase of required assessment and evaluation alongside a stagnation or decrease of funding.

There were no easy answers.

The presentation of the Boston Roundtable was intended to provide an approach to shopping for the right assessment tools as well as a critical discussion on how programs need to stop consuming every tool that comes their way and to start educating funders (one attendee said "argue with funders" and that may be the case, but we'll stake our middle ground with "educate funders") as to the realities on the ground around key issues of quality improvement. Many people wanted to know which tool was the preferred or met approval by either this organization or that trainer, however, the presentation was not a sales pitch for any one tool - but a call for people to go back to basics and ask, "what are we trying to do with all these things?" Are we researching, or managing our program? If we are using assessment and evaluation as a management tool, who do we really need to be talking to? Is there more value in self assessments? More questionnaires to children and families? Is there a balance between using face validity (going with our personal/professional observations and "gut") and formal processes?

Participants of the Boston Roundtable raised a number of issues that linked to or were directly related to the topic. These included:
The new regulations by the EEC for school-based centers, family child care, and Afterschool and Out-of-School programs do not have a clear enough plan for how to train staff (provide funding for extra time) to administer the child assessments
That arts programs are expected to deliver academics rather than focusing on their individual expertise (this may be extended to sports programs but none were represented at the meeting)
The connections to school may be valid for one kind of program but may not be the model for all programs given the diversity of program type and approach in out-of-school time (perhaps there needs to be a taxonomy of programs was not mentioned but perhaps should be discussed)
Some programs are asked to do one kind of assessment on year as a requirement and then that is dropped for another product
Program directors and on-site coordinators need to focus on staff development and that the most useful tools are those that assess staff competencies and help reduce employee turn-over - especially direct service
Programs need to stop following the system and must look to become more self-reliant economically so that they can meet the needs of the community they are in rather than attempt to align with a standard way of "doing things"

Again and again, there was a call to get organizations to take a stand on obtaining funding for the field to meet new of increased outcomes or adjust expectations to a reasonable level - focusing on what programs have historically done and can provide to our children and youth - supporting quality environments. There seems to be the subject of "quality and accountability" as it is seen through the lenses of several assessment and evaluation tools, and then what you do each day with the kids. It looks like there is a great deal more that has to be done to create tools that assist in managing a program, monitoring quality at point-of-service, and helping stakeholders have confidence in the quality and value of the program.

Perhaps we can all stand up together to bridge this gap between what and why we measure and the job we do every day working with children in our various settings.

YOU CAN FIND OUR QUALITY SELF ASSESSMENT TOOL HERE

Seamless Day?

With a snow day comes a good day to read and catch up on paperwork. There are many books on education that are part of the educator's library and of these the book 36 Children is one that continues to be read and discussed. This work was published back in 1967 and from that we can consider many things have changed in education and teaching as well as the social landscape that make this an historical text - however, there are many pages and passages where the author could be talking about 1967 or 1987 or 2007. For one thing, we seem to still be in need of educational reforms. Our inequalities have increased in many ways economically. Out cities continue to be a place the middle-class avoids to raise children rather than a center of socialization, art and learning as they historically have provided.

There is still disagreement as to what those reforms need to be, or how to reorder the learning process of our nation's young. The conversations surrounding schools impact the field of Out-of-School Time and how this field views youth development. For one thing, Out-of-School Time professionals are asked to follow the lead of in-school teachers. Out-of-School educators are asked to create standards and quality benchmarks in the name of accountability and may be required to create progress reports for each child.

This may sound like an advance for professionalism. However, when the traditional system of education, schools, and learning, is so unsettled and continues to be asked to "reform," how can Out-of-School Time educators follow knowing that the path they are taking will benefit the children and youth they serve. If schools are said to be failing children, why create more school to further fail those children? Is this a time to think critically of the direction/s schools are taking? Can youth development assist in creating healthy children and youth in a way that cannot always be linked to the school day - that an organic link is best and a seamless day the worst of both worlds?

The Boston Foundation has hosted two major school reform events in as many months - the first Boston's Education Pipeline Report Card, the other Informing the Debate: Comparing Boston's Charter, Pilot and Traditional Schools. These events were well attended by the formal education establishment but gave little room for Out-of-School providers unless Extended Learning Time is considered a representation of the current and future aspirations of the OST field. Amongst the charts the standard deviations, the two stage least squares, there remains as many questions about the effectiveness of 125 years of traditional schooling, 20 years of pilots, and 15 years of charters as to outcomes, benchmarks, and quality. And, this is with the sort of funding and inquiry that produces 114 page full color reports. Certainly 36 Children should not ring true 40 years later if the proposed advances in school reform of the past... 40 years... had achieved their goals.

Can OST afford to go down this path to quality, or must the field in the coming year look for other ways to demonstrate quality? Can the outcomes over time that quality environments for youth lead to fit into the same check boxes?

Out-of-School time will need to look hard and fast at the question of quality in the coming year so that programs can thrive and survive. It is no secret that this next fiscal year will bring with it intense pressure on programs, organizations, and individuals. We may find that in the effort to "professionalize" the field, we have lost the one part of quality that cannot be afforded no matter how many trainings or manuals are created, and that is the spirit to make a difference in the lives of young people and the work ethic to show up every working day to do so.

Sometimes things that appear to be made one way are in actuality comprised of much different material. That city pictured above. That's a collection of pots and pans.

Quality may be taking a step back and seeing that different materials can produce the same results or looking close up at what may look like a system from a distance turns out to be a number of diverse and unique parts.

North Shore Roundtables: Outcomes and Evaluations

There is a great deal of discussion at the funder level - and the policy - about how programs should assess themselves and how the diverse field of Out-of-School Time (that many say spans all ages and types of programs from year around to summer and weekend) needs to be evaluated.

There are basically two modes of thought: One proposes that Out-of-School Time needs to be evaluated vis-a-vis the school day. That improving programs means aligning them with school methods, norms, and expectations. This is a de facto if not in sutu way of extending the school day - which is a fancy way of saying Out-of-School Time becomes like-school-time. The other mode of thought is that programs need to be assessed based on the specific and unique elements that define a Out-of-School Time program and that evaluation of programs need only be against other programs. If there is improvement in academics in school and that student is a child in an Out-of-School program that is good, but not a benchmark of program quality.

The group gathered on the North Shore were lively and there were many ways people took up the idea of assessment and evaluation. There was discussion that assessment and evaluation are often used interchangeably - or at times mistakenly - to mean a similar thing (just as many competencies or outcomes are not on students but part of elements of effective management) One program director remarked that there is a distinction and one way to avoid confusion is to consider any tool to be assessment as long as it measures specific aspects of the program (an arts project, family engagement, etc) and larger program-wide data to be part of evaluating the program or organization. An interesting discussion was also about what tools promoted an academic-focus or put links to the school day or subjects as major elements of quality - missing the focus on the social-emotional development of children or the long-term values added to the community. In all, most agreed that they were not professional evaluators and that sometimes they will just collect data and "let the funders make sense of this all."

Evaluation and assessment are part of our popular mind. They are enforced by a culture of customer service that has been so pervasive in the past thirty years many of us seem not to remember a time when our civil society gave us what was good for us rather than constantly asking us what we want. Whether this is a positive or negative development has yet to be seen. Years of viewing social services as customer driven and creating an attitude that the public does not have a commonwealth but is comprised of a diverse network of consumers has indeed changed our landscape and how we interact with one another and run our programs. The resources we have placed into assessment and evaluation may perhaps give us a better point of view - or at least numbers to toss around and fun data charts we can post on our walls. However, has this process of constant assessment and evaluation led to an increase of quality at our programs? This question may actually require further evaluation. Perhaps we need to ask only those questions we want to answer - we are consumers after all...