|
December 2006
Printer-Friendly Version
|
       |
Exploring the Adolescent Life Skill Outcomes of State 4-H Congress Participation and the Different Outcomes of Gender and Race GroupsBarry A. Garst Joseph R. Hunnings Kathleen Jamison Jewel Hairston Robert R. Meadows Wendy R. Herdman Abstract: Research suggests residential 4-H programs enhance life skills. The study reported here explored the life skill outcomes of a 4-day residential State 4-H Congress. Participants were youth ages 14-18. A retrospective pre test and post test were used to evaluate life skills development. Paired sample t-tests indicated significant differences among all of the pre-test and post-test gain scores. Analysis of variance comparisons indicated males and females differed on some life skill items. The study supports the importance of purposeful planning for positive outcomes, as the greatest gains were related to Congress components that were designed to enhance specific life skills. IntroductionAlthough 4-H youth development programs are designed for youth ages 5-19, 4-H programs that involve teenagers may be particularly important for teaching leadership, citizenship, and life skills. Research suggests that the experiences that young people have during early adolescence provide the foundation on which they develop their personalities (Leffert, Saito, Blyth, & Kroenke, 1996). Transforming adolescence from a stagnant period of life into a period of positive development often requires young people to adopt a new way of thinking and a new way of viewing the world. Unfortunately, many teenagers are not exposed to situations and environments that allow them to challenge their assumptions. Kielsmeier (1988) suggests that "instead of moving steadily to full adult responsibilities, many young adults are caught in an isolated, relatively unproductive period of life where little is expected of them except to prepare for the next, more useful stage." Residential 4-H programs may be communities in which such a transformation can occur. Research suggests that residential programs and events may be particularly suited to affect youth participants in positive ways (Garst, Schneider, & Baker, 2001; Kielsmeier, 1988; Larzelere, Dinges, Schmidt, Spellman, Criste, & Connell, 2001). Residential programs and events, particularly those located outside of a participant's resident county/city, such as 4-H camp, state 4-H Congress and conferences, and national 4-H Congress and conferences, remove youth from their home communities and expose them to unique learning environments. In these novel contexts, youth may be more likely to "be themselves" and to explore new ways of thinking and behaving without the social constraints that might be present in their homes, schools, and communities (Garst & Johnson, 2005). Many studies of the life skills outcomes of 4-H youth development have been conducted over the past several years (e.g., Fitzpatrick, Gagne, Jones, Lobley, & Phelps, 2005; Seevers & Dormody, 1995). These studies examined the life skill outcomes of specific 4-H delivery modes, including: 4-H clubs (Astroth, 1996; Cantrell, Heinsohn, & Doebler, 1989; Fox, Schroeder, & Lodl, 2003), 4-H camps (Ellerbusch, Calkins, & Schwarz, 2005; Forsythe, K., Matysik, R., & Nelson, K., 2004; Garst & Bruce, 2001; Loeser, Bailey, Benson, & Deen, 2004), and 4-H youth leadership retreats (Arnold, 2003). Although several states conduct 1-week residential 4-H events that serve as the culmination of county/city and district 4-H competitions, few published studies have reported on the life-skill outcomes of this type of event. One exception was Stafford, Boyd, and Lindner's (2003) study of the Texas 4-H Roundup, in which the researchers explored whether or not a reflection component of a service learning experience offered during the Roundup influenced leadership life skills development. Research QuestionsBecause few studies have reported on the life skill outcomes of a 1-week residential 4-H event such as State 4-H Congress, the study reported here sought to better describe the potential impacts of this type of program. The first objective of the study was to identify the short-term life skills outcomes of State 4-H Congress participation. The second objective was to identify whether or not differences existed in the life skill outcomes reported by racial groups (White and African-American participants) and gender groups (male and female participants). Program DescriptionVirginia Cooperative Extension (VCE) conducts a 4-day residential 4-H event called "State 4-H Congress." State 4-H Congress is available to male and female youth ages 14-18. Although many Congress participants are senior 4-H members, 4-H membership is not a requirement of participation. County/city level 4-H Extension Agents determine the participation criteria for the youth in their unit. Some agents require youth to participate or compete in 4-H related projects and programs in order to qualify to attend Congress. Other agents use Congress as a mechanism or "hook" to involve new youth into the 4-H program or to expose youth to new and novel environments and settings outside of their own communities. This reflects one of the essential elements of positive youth development settings--that youth are given the opportunity to develop a sense of hope in the future by being exposed to new environments and opportunities for learning (University of Arizona Institute for Children, Youth, and Families, 2003). The current mission of State 4-H Congress is to provide competitive and non-competitive educational experiences to Virginia teens and the adults who work with them, helping them to develop leadership and life skills towards becoming contributing citizens in their communities. Table 1 describes the major components of State 4-H Congress, including State 4-H Competitions, Great Summer Showcase Workshops, Service Learning, Youth Issues Forum, Leadership Institute, Congressional Games, and 4-H All Star Tapping and Recognition.
One of the most important goals of the State 4-H Congress is to develop participant life skills. These life skills are conceptually located within the Head, Heart, Hands, and Health domains (Table 1). The life skills targeted (Hendricks, 1996) by Virginia's State 4-H Congress include:
Participants and MethodsParticipants in the study were youth ages 14-18 who completed a 4-day State 4-H Congress event conducted at Virginia Tech in June of 2004. All delegates were asked to complete a questionnaire on the last day of Congress. Questionnaires included questions related to program component ratings, life skills outcomes, and demographics. The life skills items were developed internally by state-level 4-H youth development specialists based upon the targeted life skills. Thus, evaluation for State 4-H Congress was a purposeful process whereby planning for evaluation occurred at the same time that the programs' targeted outcomes were identified. The pre-test portion of the questionnaire had a Cronbach's alpha of .89, and the post-test had a Cronbach's alpha of .92. A retrospective pre-test (RPT) and post-test approach was used to examine life skills changes. With this approach, participants were first asked about their level of life skills after Congress participation and then they were asked to think back to their level of life skills before participating in Congress. RPT has been widely used in program evaluation across multiple disciplines. In addition to saving time and being more enjoyable to participants (they only have to complete one questionnaire), RPT also helps to avoid a response-shift effect (Howard, 1980), whereby a respondent's frame of reference or evaluation standard changes during participation in the program. ResultsParticipant DemographicsA total of 530 male and female youth ages 14-18 completed the 4-day State 4-H Congress. Of these participants, a sample of 245 youth completed an end-of-the-week questionnaire for a response rate of 46%. Sixty-two percent were first-time participants. Sixty-three percent were female. The most prominent ethnic groups were White (64%) and African American (10%). The mean age was 16 years old. Life Skill OutcomesTen items on the questionnaire asked Congress participants to identify the degree to which participation in State 4-H Congress helped them to acquire life skills. Comparisons were made between each of the "before Congress" and "after Congress" means using paired t-tests (Table 2). While significant differences were found (p<.05) between all of the "before Congress" and "after Congress" means, the greatest gains were found with the following items:
Life Skills Comparisons of Demographic GroupsThe life skill gains of White delegates and African-American delegates were compared (Table 3). Both White and African-American delegates indicated that life skills gains were achieved in three of the same life skills areas (Table 3). However, African-American delegates indicated greater gains for the item, "demonstrate the skills of a good leader" (0.39) than White delegates (0.24). A one way analysis of variance (ANOVA) was performed to determine if there were significant differences between White and African-American delegates and reported life skill development as a result of Congress participation. Significant differences (p<.05) were not found for any item.
The life skill gains of male delegates and female delegates were also compared (Table 4). Both male and female delegates indicated that significant life skills gains were achieved related to "identify needs in my community and work to meet those needs." However, there were several differences. Male delegates identified gains in the areas of "clearly state my thoughts, feelings, ideas to others" and "use my time wisely," and these gains were greater than the gains in the same items for females. Female delegates identified gains in the areas of "think critically about my future and set goals for my future" and "have friendships with people who are different from me," and these gains were greater than the gains in the same items for males. A one-way analysis of variance (ANOVA) was performed to determine if there were significant differences between male and female delegates and reported life skill development as a result of Congress participation. Significant gender differences (p<.05) were not found for any items (Table 4).
ConclusionsThe results of the evaluation suggest that State 4-H Congress participation enhanced the life skills of teen delegates. Although these results support the value of State 4-H Congress, they also support the importance of purposeful programming. The greatest life skills gains (Table 2) appear to be related to the programmatic components of Congress (e.g., Great Summer Showcase Workshops Service Learning, Youth Issues Forum, Leadership Institute) that were specifically selected to target identified life skills. For example, the emphasis on service learning experiences at Congress may have influenced the gains in the life skill "identify needs in [my] community and work to meet those needs." Likewise, the exposure to educational experiences in novel environments may have influenced gains in the life skill, "think critically about [my] future and set goals for [my] future." Finally, the opportunities that Congress provided for delegates to interact with other youth from across the state in a wide variety of educational and social situations may have influenced the life skills gains related to, "have friendships with people who are different from [me]." The results of the study failed to show a significant difference between the life skills gains according to race and gender. The lack of significant differences between males and females may contradict Stafford, Boyd, and Lindner's (2003) study of life skill development through community service, where females reported themselves as having more effective team skills than males. In the study reported here, male and female delegates were engaged in a community-service type experience during Congress, yet such differences were not found. This suggests that the Virginia State 4-H Congress was equally effective for enhancing the life skills of all delegates regardless of race and gender. ImplicationsThe study supports the important role that residential 4-H programs such as State 4-H Congress may play in the development of life skills towards positive youth development. Although many Congress-style programs and events emphasize activities such as 4-H competitions, it is important to recognize the related life skill development that these programs and events foster. In an environment of increasing accountability, research projects that identify program outcomes are critical. Although many states conduct Congress-style programs and events, they may not have a purposeful evaluation process established to evaluate whether or not desired outcomes are achieved. These results remind us of the importance of being purposeful in our Extension efforts. ReferencesArnold, M. E. (2003). Using a multi-site methodology to evaluate 4-H youth leadership retreats. Journal of Extension [On-line], 41(6). Available at: http://www.joe.org/joe/2003december/rb1.shtml Astroth, K. (1996). Leadership in non-formal youth groups. Does style affect youth outcomes. Journal of Extension [On-line], 34(6), Available at: http://www.joe.org/joe/1996december/rb2.html Cantrell, J., Heinsohn, A. L., & Doebler, M. K. (1989). Is it worth the costs? Journal of Extension [On-line], 27(1). Available at: http://www.joe.org/joe/1989spring/a4.html Ellerbusch, K. M., Calkins, C. F., & Schwarz, J. (2005). An evaluation of the effectiveness of life skill development in Missouri's 4-H youth resident summer camps. University of Missouri Extension. Fitzpatrick, C., Gagne, K. H., Jones, R. Lobley, J., & Phelps, L. (2005) Life skills development in youth: Impact research in action. Journal of Extension [On-line] 43(3) Article 3RIB1. Available at: http://www.joe.org/joe/2005june/rb1.shtml Forsythe, K., Matysik, R., & Nelson, K. (2004). Impact of the 4-H camp counseling experience. Research Paper. Department of Youth Development. University of Wisconsin-Extension. Fox. J., Schroeder, D., & Lodl, K. (2003). Life skill development through 4-H clubs: The perspective of 4-H alumni. Journal of Extension [On-line], 41(6). Available at: http://www.joe.org/joe/2003december/rb2.shtml Garst, B. A. & Johnson, J. (2005). Adolescent leadership skill development through residential 4-H camp counseling. Journal of Extension [On-line], (43)5 Article 5RIB5. Available at: http://www.joe.org/joe/2005october/rb5.shtml Garst, B. A., Schneider, I. E., & Baker, D. A. (2001). The impact of the outdoor adventure experience on adolescent self-perception. Journal of Experiential Education, 24(1) 41-49. Hendricks, P. (1996). Targeting life skills model: Incorporating developmentally appropriate learning opportunities to assess impact of life skills development. Ames, IA: Iowa State University. Howard, G.S. (1980). Response-shift bias: A problem in evaluating interventions with pre/post self reports. Evaluation Review, 4(1), 93-106. Kielsmeier, J. (1988). Outdoor centers and camps: A 'natural' location for youth leadership development. ERIC Clearinghouse on Rural Education and Small Schools Digest. Las Cruces, NM. Retrieved on December 1, 2005 from http://www.ed.gov/databases/ERIC_Digests/ed296811.html Larzelere R. E.; Dinges K.; Schmidt M. D.; Spellman D. F.; Criste T. R.; Connell P. (2001). Outcomes of residential treatment: A study of the adolescent clients of girls and boys town. Child and Youth Care Forum, 30(3), 175-185(11). Kluwer Academic/Plenum Publishers, New York. Leffert, N., Saito, R. N., Blyth, D. A., & Kroenke, C. H. (1996). Making the Case: Measuring the Impact of Youth Development Programs. Minneapolis, MN: Search Institute. Loeser, D. M., Bailey, S. J., Benson, R. L., & Deen, M. Y. (2004). Measuring impacts with young audiences: Adapting a life-skills Instrument for Use with third- to fifth-grade youth. Journal of Extension [On-line], 42(4). Available at: http://www.joe.org/joe/2004august/rb1.shtml National 4-H Impact Assessment Project (2001). Prepared and engaged youth: National 4-H impact assessment project. USDA, CSREES, Washington, D.C. Seevers, B. S. & Dormody, T. J. (1995). Leadership life skills development: Perceptions of senior 4-H youth. Journal of Extension [On-line], 33(4). Available at: http://www.joe.org/joe/1995august/ent.html#rb1 Stafford, J., Boyd B., & Lindner, J. R. (2003). Community service versus service-learning: Which is best for 4-H? Journal of Extension [On-line], 41(6). Available at: http://www.joe.org/joe/2003december/a1.shtml University of Arizona Institute for Children, Youth, and Families. (2003). National 4-H impact assessment project: Prepared and engaged youth serving American communities. Tucson, AZ: Author. This article is online at http://www.joe.org/joe/2006december/rb2.shtml. Copyright © by Extension Journal, Inc. ISSN 1077-5315. Articles appearing in the Journal become the property of the Journal. Single copies of articles may be reproduced in electronic or print form for use in educational or training activities. Inclusion of articles in other publications, electronic sources, or systematic large-scale distribution may be done only with prior electronic or written permission of the Journal Editorial Office, joe-ed@joe.org. If you have difficulties viewing or printing this page, please contact JOE Technical Support. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||