Education Center for Adoptive Parents Online (ECAPO) - Phase I Final Report
Wendt, Adam, Principal Investigator
1R43HD056646-01
Project Period: 06/01/2007 - 02/28/2009
Overview of Project Tasks
The central aim of this Phase I project was to enhance the competence of adoptive parents, and by extension advance the long-term healthy adjustment of adopted children, by creating a parent training program uniquely tailored to meet the needs of adoptive parents. The Education Center for Adoptive Parents Online (ECAPO) is intended to be available to pre- and post- adoptive parents and offer a training approach grounded in theories of development, social cognitive theory and adult instruction. ECAPO targets factors known to mediate the effects of risk factors on adopted children's outcomes. To meet the needs of busy adoptive parents, ECAPO was delivered online using a unique set of skill-building instructional components. An innovative feature of this program is a sophisticated web delivery platform, IRIS Ed Online (IEO).
Phase I included the following tasks: (1) Convene a development team to draft a content outline and align content with instructional delivery; (2) Facilitate two separate focus groups and conduct key informant interviews; (3) Produce Phase I program assets, upload them to the website, and conduct a usability evaluation; and (4) Evaluate the program's effectiveness to demonstrate feasibility for Phase II with respect to knowledge, attitudes/beliefs, behavioral intentions, and self-efficacy in effectively communicating about adoption-related issues within the family system.
Task 1 - Development Team Drafts Content Outline and Aligns Content with Instructional Delivery
The Principal Investigator led a development team in drafting a content outline for Module 1, Developing communication skills about adoption-related issues in the family, a topic identified by experts as particularly critical to adoptive families. The development team consisted of the Principal Investigator, Media Developer, and Instructional Media Designer. Content for this module was developed in consultation with expert content consultant Astrid Dabbeni, of Adoption Mosaic. Recognizing the important role of communication in shaping adoptee adjustment, the team focused on identifying key approaches to promoting honest, sensitive communication about adoption within the family. Such communication balances children's need for information about their background with their developmental capacity for understanding, and acknowledges the adoptive family's uniqueness without placing undue emphasis on what makes it distinctive. A content outline covering these main points was prepared for discussion with focus groups and key informants: (1) Rationale for open communication within the adoptive family and response to parental fears about the effects of communication, (2) How to prepare for open communication, (3) Using natural opportunities to discuss adoption issues, (4) Tools for normalizing adoption, and (5) Age-appropriate skills for communicating with children 0-3 yrs old (In Phase II, we will address communication with additional children in older developmental groups, i.e. 3-7, 8-12, 13-17, and 18-21 years old.
Task 2 - Input From Direct and Indirect Consumers
We originally proposed to conduct two focus groups (one with adoptive parents and one with adult adoptees) and key informant interviews with professionals in the field of adoption. This plan met with reviewer concerns regarding psychological risks to subjects as a result of their participation in the group process. Consequently, the Principal Investigator sought and received approval to modify the focus groups from a group setting to individual interviews as follows:
Adoptive parent interviews
Two Caucasian, non-Hispanic females with college degrees and an average age of 44 were interviewed. While both felt well-prepared to become adoptive parents, they acknowledged being uncomfortable in certain situations and unprepared for questions posed by their adopted children. Challenges were identified around race, age, communication, defiance and attachment issues. These parents found the local adoptive community to be supportive. When asked what they would include in a program for adoptive parents, they mentioned race, attachment, and dealing with problem behavior. The program should be positive and engaging, and should include personal testimonies that show parents' struggles and discuss the complexity of adoption from a variety of perspectives.
Adult adoptee interviews
Our informants were two females who had been adopted from South Korea. Both said that their parents seldom spoke about their adoptions, and when they did it was generally only at the child's initiation. Communication about their birth parents or about their parents' reasons for adopting was difficult. As children, neither informant had close friends who were adoptees. Their recommendations for an adoption program focused on communication (e.g., raising issues before they arise, dealing with children's questions around country of origin and the birth parents), cultural competency, positive parenting, and finding support in the adoptive community.
Adoption professionals
Key informant interviews were conducted with two professional informants (a clinical psychologist and a government adoption agency supervisor) who interact with adoptive families at least twice monthly. They identified the most challenging concerns of adoptive parenting as attachment issues, communication, developmental issues, trauma reactions, medical issues, emotional regulation, and behavioral issues around the transition from foster care. Specific recommendations were made for meeting adoptive parents' and children's needs in developmentally appropriate ways. Informants recommended that training for adoptive parents appeal to women and men, and that it include the following topics: communication, dealing with others' reactions, strengthening attachment with the child, behavior management, working with the Department of Human Services, and the adoption process itself.
Task 3 - Produce Phase I Program Assets, Upload to Website, and Conduct Program Usability Test
Content finalization
The development team incorporated feedback from key informant interviews in developing specific content for the videos, exercises, printables and other related media assets. The decision was made to structure the open communication topic into four modules: Module 1: Introduction, Module 2: About open communication, Module 3: Creating opportunities for open communication, and Module 4: An overview of approaches for age-appropriate communication with a focus on the birth to three-year-old developmental age range.
Scripts were developed for each program asset in these four modules. Since the goal of the program was instructional and skill-building, video scripts attempted to balance exposition and explanation with situational modeling vignettes.
Production of assets
Program materials were actualized by a team of experienced media professionals with expertise in graphic art, Flash programming, video directing and editing, sound engineering, lighting, and production coordination. The various online assets (videos, printables, etc.) were produced along separate but coordinated tracts. All visual materials in the program were required to reflect gender balance and racial and ethnic diversity. Video sequences were shot on location using actors and were edited at IRIS Media prior to encoding to Flash Video format and uploading to IEO. The Principal Investigator was responsible for reviewing all program assets and recommending changes to make the presentation accurate and relevant as well as engaging to adoptive families.
Online upload
After program assets were completed, they were uploaded to the IEO website training interface using proprietary content management software. The program was tested and retested by project staff. Minor navigational bugs were identified and corrected.
Usability and pilot testing
Following the upload, the ECAPO program and online evaluation surveys underwent usability tests involving five IRIS staff members not directly related to the program development and five out-of-house beta testers made up of adoptive parents and adoption professionals. These tests were conducted to ensure the program technology was working properly. Minor corrections were made to the interface in response to these usability tests.
Task 4 -Demonstrate Feasibility for Phase II
A two panel, pre- and post-training design was used to assess the feasibility of the ECAPO training program. During this quasi-experimental trial phase, consumer satisfaction ratings were assessed and recommendations for program modification were solicited from program participants. We also examined system log files to assess participant engagement in using the online program (e.g., time of use, program components viewed, number of visits). While the design did not control for potential threats to internal validity (i.e., extraneous factors), it did allow for the evaluation of the online program with respect to change in knowledge, attitudes/beliefs, behavioral intentions, and self-efficacy regarding communication about adoption related issues within the family. Threats to internal validity will be addressed during Phase II by conducting a large-scale randomized controlled trial comparing parents assigned to the ECAPO training program to an alternate treatment control group.
Participants
Participation was limited to adoptive parents (one parent per family) who were adopting for the first time, had adopted a child within the last 24 months, had an adopted child under the age of three, and had an Internet connection and email address. During the month-long recruitment, 129 adoptive parents completed the online eligibility screening and a total of 38 adoptive parents met project eligibility requirements and completed the pre-training (T1) assessment. Only four participants failed to activate their program license after completing the T1, and another four failed to fully complete the intervention program and finish the T2 assessment. Of these, two reported having computer problems, and one who asked to be removed from the study due to lack of time and personal conflicts unrelated to the materials or presentation.
Procedures
We adhered to the following procedures, which we have previously used with success to conduct other online studies (e.g., Colvin & Marquez, 2008; Metzler, Seeley, & Marquez, 2008).
IRIS created a website for the purpose of managing participation in the research study. Recruitment flyers were sent out to adoptive families via Adoption Mosaic's extensive listserv, and to adoption agencies, service providers and project consultants. The flyers invited individuals to access the study website, which provided a brief written explanation of the project and directed interested parents to an online eligibility screening. Screening criteria required participants to be adoptive parents who were adopting for the first time, had adopted a child within the last 24 months, had an adopted child under the age of three, and had email and Internet access. Only one parent per family could participate.
Eligible participants were directed to a secure webpage on IRIS Media's DatStat system, which provided a detailed written description of the study procedures and invited participants to complete an online informed consent. Consenting participants then completed the pre-training assessment (T1) using the same secure website. Following the T1 assessment, participants were cleared to participate in the intervention phase, which provided access to the four modules of the Phase I training program. Participants were allowed two weeks to complete these modules. At the end of two weeks, participants were sent an email asking them to complete the post-training assessment (T2), which included a user satisfaction questionnaire. After three days, another email reminder message was sent to those who had not completed the T2.
Measures
A table of measures and a schedule of their use is provided below Copies of the instruments used in Phase I are provided in Appendix B: Phase I Instruments.
| Measures | T1 Pre Assessment | Intervention | T2 Post Assessment |
|---|---|---|---|
| Demographic Survey | X | Modules 1- 4 | |
| Knowledge Test | X | X | |
| Behavioral Intention to Change | X | X | |
| Self-Efficacy | X | X | |
| Consumer Satisfaction Survey | X | ||
| Usability | X |
Demographic Survey (T1)
Basic demographic variables included participant age, gender, ethnicity, and months since adoption. Participants were 73% female and 27% male, with 3% percent Hispanic, 3% Asian, 3% indicating more than one race, and 94% Caucasian.
Knowledge Test (T1, T2)
The knowledge check was based on the parent training concepts presented in the ECAPO Phase I program.
Behavioral Intention to Change (T1, T2)
A behavioral intention measure (BI) was used to determine intention to use the concepts covered in the training modules. The BI used constructs derived from the Theory of Reasoned Action (Ajzen & Fishbein, 1973) and Theory of Planned Behavior (Ajzen, 1985) that suggest that attitudes/beliefs and behavioral intentions influence behavior. The BI questionnaire used a Likert-type scale to assess the likelihood of applying the concepts taught in parent training sessions.
Self-Efficacy (T1, T2)
Because Bandura's Social Cognitive Theory (Bandura, 1977) suggests a relationship between self-efficacy and outcome behavior, a self-efficacy measure (SE) was employed. Likert-type items were used to document changes in participants' perceptions of their mastery of the skills presented in the program and their self-efficacy to perform them as a function of this training. The SE items included the Nurturance subscale of the Self-Efficacy for Parenting Tasks Index (SEPTI: Coleman & Karraker, 2000), which uses a 6-point Likert scale, along with several additional items that specifically assess communication-related issues within adoptive families. The SEPTI has acceptable internal consistency for subscales and total scale (range = .73 - .91). We generated a pool of 15-20 items for each measure (i.e., knowledge, attitudes, behavioral intentions, and self-efficacy) covering the adoption-related communication training. Item analytic procedures were used to create psychometrically sound scale scores (e.g., principal components analysis, internal consistency analysis, frequency distributions and plots). These curriculum-based measures were developed during the formative phase of the study and piloted during usability testing.
Consumer Satisfaction (T2)
A user satisfaction questionnaire modeled after measures developed for other projects was developed by project staff. Fourteen Likert-type items measured stimulation, comprehension, ownership, and persuasiveness. Open-ended comments were also solicited. For a listing of items, please see Table 3: Consumer Satisfaction below.
Usability (T2)
Data was gathered using a modification of the System Usability Self-Report Scale following recommendations from Tullis and Stetson's (2004) research. We used an 8-item adaptation of Brooke's (1996) widely-used System Usability Scale (SUS) to rate the usability of the website. Structured on a 6-point Likert scale (strongly agree to strongly disagree), questions were designed to solicit overall feedback on the navigation (e.g., It is easy to move from one page to another), visual appeal (e.g., Individual pages were well designed), organization (e.g., The overall organization of the site is easy to understand), and ability to complete tasks using the website interface (e.g., I was able to complete my tasks in a reasonable amount of time).
Data analysis
Prior to analysis, all variables underwent a check for out-of-range values and inter- and intra-measure consistency; frequency distributions and plots were examined for unusual data distributions or data points. The main analysis tested the hypothesis that participants would show significant improvement in their knowledge, attitudes, behavioral intentions, and self-efficacy toward applying the adoptive parent training concepts. A within-subject, repeated measures approach was used to test for change in the measures by comparing the baseline scores obtained at the pre-training assessments to scores obtained during the post-training assessments. Doubly multivariate repeated measures ANOVA and paired t-tests were conducted on the measures assessed at pre- and post-training. Outcome differences were examined with respect to length of adoptive parenting and demographics by including a between-subjects factor into the repeated measures ANOVA models.
To bolster our confidence in the internal validity of the quasi-experimental design, additional ancillary analyses were conducted. First, a dose-response analysis based program system usage log files was conducted to determine whether the amount of program use (e.g., time of use, program components viewed, number of visits) was significantly associated with change in the outcome measures. Residual gain score analyses was conducted using linear regression models to predict post-training test scores in which the pre-training test scores was included as a covariate. Second, we tested the hypothesis that parents who report greater satisfaction with the online training program would have greater improvement in pre- to post-training scores using residual gain score analysis. Finally, treating consumer satisfaction as a process variable, we examined correlations between satisfaction ratings and amount of program use. To the extent that there was sufficient variability in program use and consumer satisfaction, positive associations between these measures and change in pre- to post-training scores provided further support for the acceptability and effectiveness of the program. Based on the two-panel design with a sample size of 38 adoptive parents, with a two-tailed alpha set to .05, we had sufficient power (.87) to detect medium effects (d = 0.5) for pre- to post-training change. Analyses involving correlation coefficients would have adequate power to detect medium effects (r = .42).
Program efficacy
Table 2 below presents the pre-test and post-test means and standard deviations as well as the paired t -test results and effect sizes for the outcome measures: knowledge, attitudes, behavioral intentions, and self-efficacy. As can be seen, significant effects were obtained on all four outcome measures; a medium effect size was obtained for the knowledge test (d = .42), and large effects sizes were obtained for attitudes (d = .76), behavioral intentions (d = .77), and self-efficacy (d = 1.05). It should be noted that significant pre-post improvement was found in spite of the rather high pre-test mean levels on the outcome measures. That is, the participants had high baseline knowledge (M percent correct = 92.7) as well as attitudes, behavioral intentions, and self-efficacy (all pretest Ms > 4.2 on 5-point Likert-type scales).
| Outcome Measure | Pre-test | Post-test | t | p-value | Effect Size | ||
|---|---|---|---|---|---|---|---|
| M | SD | M | SD | ||||
| Knowledge | 92.7 | 11.1 | 98.0 | 6.1 | 2.28 | 0.030 | 0.42 |
| Attitudes | 4.4 | 0.5 | 4.7 | 0.4 | 4.18 | <0.001 | 0.76 |
| Behavioral Intentions | 4.5 | 0.4 | 4.8 | 0.2 | 4.23 | <0.001 | 0.77 |
| Self-efficacy | 4.2 | 0.5 | 4.6 | 0.3 | 5.74 | <0.001 | 1.05 |
| Note: Effect Size is being reported as Choen's d. All tests used 36 degrees of freedom. | |||||||
Program utility-usability
Thirty-four participants activated the program license granting access to the intervention. Of these, 29 accessed the site multiple times over the course of the evaluation period. Thirty participants completed the T1 and T2 assessments and all components of the intervention, spending an average of 83 minutes viewing program videos, writing in journals, reviewing knowledge checks and downloading printables. Many participants revisited the site after completing all evaluation activities.
Consumer satisfaction
ECAPO program modules received excellent scores on the Consumer Satisfaction questions (Table 3) and elicited enthusiastic comments from study participants.
| Table 3: Customer Satisfaction | Strongly/Mostly Agree | Slightly Agree | Slightly Disagree | Mostly/Strongly Disagree |
|---|---|---|---|---|
| Overall, I was satisfied with the quality of this training. | 93% | 7% | ||
| I was satisfied with the quality of the information. | 100% | |||
| The training met my expectations. | 87% | 13% | ||
| I would recommend the training to other parents. | 90% | 10% | ||
| The training content was well organized. | 100% | |||
| It was easy to understand the ideas presented in the program. | 100% | |||
| Much of the information was new to me. | 17% | 27% | 57% | |
| I agree with the ideas presented in the training. | 97% | 3% | ||
| I am likely to use many of the strategies described in the training. | 93% | 7% | ||
| The materials gave me new ideas about how to practice open communication about my child's adoption. | 57% | 23% | 7% | 13% |
|
The training was engaging. |
77% | 20% | 7% | 13% |
| It will be easy for me to implement this approach. | 100% | |||
| The knowledge I gained through the training will help my family lay the groundwork for effective open communication. | 80% | 20% | ||
| The training was comprehensive. | 70% | 20% | 7% | 3% |
A number of participants commented on the relevance of the program to adoptive parents. Many participants remarked that the training was clear, well-organized and easy to understand. The majority of study participants commented on the high quality of the video footage and appreciated the realistic nature of the training. A number of them praised the printables. When study participants were asked "How would you have liked the training to be different?" many commented that they wanted greater detail, and many expressed a desire for additional materials. A few commented that they wished that the training were not geared only to parents of young adopted children ages birth to three. Some sample comments from the open-ended section include the following:
"(The program was) self paced (and the) open communication and age appropriate communication segments were most useful."
"It was nice to see the same conversation from the various age groups."
"(I liked) the examples? (and the) videos of people acting out potential situations."
"(Illustrations of) differences in approaches were very good and helpful."
Lessons Learned and Directions for Phase II
In Phase I, we proposed developing a program for adoptive parents that addressed the need for healthy communication about adoption-related issues within the family. Research indicated that the important factors for healthy communication are:
- Importance of assuming a supportive and open style of communication about adoption-related-issues
- Using unbiased adoption language
- Awareness of stages in children's developmental understanding of adoption
- Building knowledge and skills in communicating age-appropriate information
- Providing training and skill-building opportunities in essential communication skills
In the first phase of this project we accomplished our two primary goals. First, we demonstrated that we could produce online parent education materials suitable for adoptive parents. The prototype online multimedia program for adoptive parents uses video-driven lessons to model targeted skills, provides practice opportunities through interactive mastery exercises and interactive assessments, offers opportunities for self-reflection through the program's journaling tool, and provides printable resource material. We employed a sound, iterative development process that was informed by expert consultants and by a range of professionals concerned with adoptive parent education.
Second, our feasibility evaluation with a representative group of parents showed that the program has a great potential for being an effective training intervention for adoptive parents. Furthermore, direct and indirect consumers found the materials to be attractive, engaging and appropriate for this population.
Although the Phase I sample showed high pre-test mean levels on the outcome measures, indicating that participants were knowledgeable about many of the overall concepts, they still showed significant pre-post improvement. It is probable that participants' strong baseline knowledge was because our recruitment efforts were centered on the Adoption Mosaic (AM) listserv, whose subscribers include many adoptive parents who have attended past AM adoptive training. It is natural to assume that many of the concepts presented in the training were familiar to the participants from having participated in AM workshops. In Phase II, with greater time and resources at our disposal, we intend to focus our screening in order to recruit new adoptive parents who have not had an opportunity to attend extensive training.
Despite familiarity with adoption issues, participating adoptive parents improved their knowledge about communication across child developmental ages and attitudes regarding attachment and birth parent issues. They also developed skills in talking openly about adoptive family issues with their children and greater self confidence in creating opportunities for such conversations.
We believe these results provide ample justification for continuing with development of the complete curriculum. In Phase II, we plan to expand the curriculum to include six modules with the following themes: (1)Understanding adoption (issues of attachment, identity, race, culture, etc.); (2) Communication within the family about adoption-related issues (expanded to include all developmental ages); (3) Communication with extended family, the outside world, and school about adoption-related issues; (4) Promoting adopted children's resilience in the family context; (5) Remedial parenting in the adoptive context (counteracting risk); and (6) Cultural competence in raising the transracially and/or transculturally adopted child. In order to encourage trainers from state, county, or local community programs to implement the ECAPO program in their outreach, we will include a separate trainer's implementation module that will contain a curriculum guide and will provide access to a content management system that allows training organizations to place their logo on the site, customize content (e.g., add state regulations, provide tip sheets, etc.), and monitor use of the site in order to certify completion and support users' efforts.
The primary goal of Phase II will be to complete the ECAPO program and to evaluate the efficacy of the program with a randomized controlled trial with 256 parents (one per family). Participants will be randomly assigned to either the ECAPO program (treatment) or to an alternate treatment control group with access to informational web sites on basic adoptive parenting skills. Parents in the control condition will be given access to the ECAPO program at the conclusion of the efficacy trial. The design will include three assessment waves over a 12 week period: baseline, interim-training at three weeks, and follow-up at 12 weeks.
References
Abidin, R.R. (1995). Parenting Stress Index (3rd ed.). Odessa FL: Psychological Assessment Resources.
Ajzen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckman (Eds.), Action-control: From cognition to behavior (pp. 11-39). Heidelberg, Germany: Springer.
Ajzen, I., Albarracin, D., & Hornik, R. (2007). Prediction and change of health behavior: Applying the reasoned action approach. Mahwah, NJ: Lawrence Erlbaum.
Ajzen, I. & Fishbein, M. (1973). Attitudinal and normative variables as predictors of specific behaviors. Journal of Personality and Social Psychology, 27, 41-57.
Ajzen, I. & Fishbein, M. (1979). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84 (5), 888-918.
Ajzen, I. & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice-Hall.
American Library Association (2009). ALA Library Fact Sheet 1. Chicago, IL: American Library Association.
American Psychological Association, (1985). Standards for educational and psychological tests. Washington, DC: APA.
American Society for Training and Development (2001). A Vision of e-Learning for America's Workforce: Report of the Commission on Technology and Adult Learning (ED455432). Alexandria, VA.: American Society for Training and Development.
Ames, E.W. (1997). The development of Romanian orphanage children adopted to Canada. Final report to Human Resources Development Canada.
Amidon, L. E. (2001). Designing interactive multimedia instruction to enable and enhance information literacy. Journal of Interactive Instruction Development, 13(4), 26-33.
Bandura, A. (1969). Principles of Behavior Modification. New York: Holt, Rinehart, and Winston.
Bandura, A. (1977). Social learning theory. Engelwood Cliffs, NJ: Prentice-Hall.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191-215.
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: W.H. Freeman and Company.
Barrera, M., Biglan, A., Taylor, T. K., Gunn, B. K., Smolkowsky, K., Black, C. et al. (2002). Early elementary school intervention to reduce conduct problems: A randomized trial with Hispanic and non-Hispanic children. Prevention Science, 3(2), 83-94.
Barth, R.P., Gibbs, D.A, & Siebenaler, K. (2001). Assessing the field of post-adoption service: Family needs, program models and evaluation issues. Chapel Hill and Research Triangle Park: University of North Carolina School of Social Work, Jordan Institute for Families, and Research Triangle Institute.
Barth, R.P. & Miller, J.M. (2000). Building effective post-adoption services: What is the empirical foundation? Family Relations, 49(4), 447-477.
Baum, L. (2002). Factors related to use of Internet parent support groups by primary caregivers of a child with special health care needs (Doctoral dissertation, University of Utah, 2002). Dissertation Abstracts International, DAI-B 63/02, 734, Publication #AAT 3041616.
Biglan, A., & Metzler, C.W. (1998). A public health perspective for research on family-focused interventions In: Drug abuse prevention through family interventions. In R.S. Ashery, E.B. Robertson, & K.L Kumpfer,. (Eds.), NIDA Research Monograph 177 (pp. 430 458). NIH Publication NO. 99-4135. Washington, DC: National Institute on Drug Abuse.
Billington, D. D. (2006). Seven characteristics of highly effective adult learning programs. New Horizons for Learning (online journal), 2 (3).
Bock, R. D. (1989) Addendum - Measurement of human variation: A two-stage model. In R. D. Bock (Ed.) Multilevel analysis of educational data (pp. 319-342). New York: Academic Press.
Bornstein MH. (1995). Parenting infants. In M. Bornstein (Ed.), Handbook of parenting, Vol. 1 (pp. 3-39). Mahwah, NJ: Lawrence Erlbaum.
Brigham Young University (2003). Independent Study Data. Unpublished raw data, Brigham Young University.
Brodzinsky, D.M. (2005). Reconceptualizing openness in adoption: Implications for theory, research, and practice. In D.M Brodzinsky and J. Palacios (Eds.), Psychological issues in adoption. Westport, CT: Praeger.
Brodzinsky, D.M. & Pinderhughes, E. E. (2002). Parenting and child development in adoptive families. In M. Bornstein (Ed). Handbook of parenting, 2nd Edition, Vol. 1 (pp. 279-312.). Mahwah, NJ: Lawrence Erlbaum.
Brodzinsky, D.M., Schechter, D.E., Braff, A.M. & Singer, L.M. (1984). Psychological and academic adjustment in adopted children. Journal of Consulting and Clinical Psychology, 52, 582-590.
Brodzinsky, D.M., Smith, D.W., & Brodzinsky, A.B. (1998). Children's adjustment to adoption: Development and clinical issues. Thousand Oaks, CA: Sage.
Bronfenbrenner, U., & Ceci, S. J. (1994). Nature-nurture reconceptualized in developmental perspective: a Bioecological model. Psychological Review, 101(4), 568-586.
Brooks, D., Allen, J. & Barth, R.P. (2002). Adoption service use, helpfulness, and need: A comparison of public and private agency and independent adoptive families. Children and Youth Services Review, 24, 213-238.
Brooks, D., Simmel, C., Wind, L. & Barth, R.P. (2006). Contemporary adoption in the united states: Implications for the next wave of adoption theory, research and practice. In D. M. Brodzinsky & J. Palacios (Eds.), Psychological issues in adoption (pp. 1-25). Westport, CT: Praeger.
Brown, M., Yando, R., & Rainforth, M. (2000). Effects of an at-home video course on maternal learning, infant care and infant health. Early Child Development and Care, 160, 47-65
Bureau of Labor Statistics, U.S. Department of Labor (2007). Occupational Outlook Handbook, 2008-09 Edition, Retrieved March 10, 2009, from http://www.bls.gov/oco/ocos069.htm
Carter, M.C., Ames, E.W. & Morrison, S.J. (1995). Attachment security and indiscriminately friendly behavior in children adopted from Romanian orphanages. Developmental Psychopathology, 7, 283-294.
Christensen, H., Griffiths, K. M., & Korten, A. (2002). Web-based cognitive behavior therapy: Analysis of site usage and changes in depression and anxiety scores. Journal of Medical Internet Research, 4(1): e3.
Coleman, P.K., & Karraker, K.H. (2000). Parenting self-efficacy among mothers of school-age children: Conceptualization, measurement, and correlates. Family Relations, 49, 13-24.
Colvin, G., & and Marquez, B. (2008). Managing Middle School Classrooms: Online Behavior Expectations. Eugene, OR: IRIS Media, Inc.
Cowan, P. A., Powell, D., & Cowan, C. P. (1997). Parenting interventions: A family systems perspective. In I. E. Sigel & K. A. Renninger (Eds.), Handbook of child psychology: Vol 4. Child psychology in practice (5th ed., pp. 3-72). New York: Wiley
Cradler, J. & Cradler, R. (1995). Prior studies for technology insertion. San Francisco: Far West Laboratory.
Dodge, K. A., Pettit, G. S., & Bates, J. E. (1994). Socialization mediators of the relation between socioeconomic status and child conduct problems. Child Development, 65(2), 649-665.
Dumka, L. E., Roosa, M. W., Michaels, M. L., & Suh, K. W. (1995). Using research and theory to develop prevention programs for high risk families. Family Relations, 44, 78-86.
Dumka, L. E., Garza, C. A., Roosa, M. W., & Stoerzinger, H. D. (1997). Recruitment and retention of high-risk families into a preventive parent training intervention. The Journal of Primary Prevention, 18 (1), 25-39.
Dumka, L.E., Stoerzinger, H., Jackson, K., & Roosa, M.W. (1996). Examination of the cross cultural and cross language equivalence of the parenting self-agency measure. Family Relations, 45, 216-222.
EP Global Communications, Inc. (2008). Exceptional Parent Magazine. Johnstown, PA: EP Global Communications, Inc.
Engelmann, S. & Carnine, D. (1982). Theory of instruction: Principles and applications. New York: Irvington Press.
Evan B. Donaldson Adoption Institute, (1997) Public Opinion Benchmark Survey. New York: Evan B. Donaldson Adoption Institute.
Fishbein, M. (1996). Behavior and biological measures: can they serve as markers for each other. Paper presented at the 1996 National STD Prevention Conference; December 9-12; Tampa, FL.
Fishbein, M. (1999). The Contribution of Behavioral Science to Prevention of STDs. Paper presented at the International Society for Prevention of Sexually Transmitted Diseases, Denver, Colorado.
Fishbein, M. (2000). The role of theory in HIV prevention. AIDS Care, 12 (93), 273-278.
Fisher, W A. (1984). Predicting contraceptive behavior among university men: The roles of emotions and behavioral intentions. Journal of Applied Social Psychology, 14, 104-123.
Fisher, W. A., Fisher, J. D., & Rye, B. J. (1995). Understanding and promoting AIDS-preventive behavior: insights from the theory of reasoned action. Health Psychology, 14(3):255-264.
Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
Fletcher, J. D. (1989). The effectiveness and cost of interactive videodisc instruction. Machine-Mediated Learning, 3(4), 361-385.
Fraley, R. C. (2004). How to conduct behavioral research over the Internet: A beginner's guide to HTML and CGI/Perl. New York: Guilford Press.
Frank, D., Klass, P., Earls, F., Eisenberg, L. (1996). Infants and young children in orphanages: One view from pediatrics and child psychiatry. Pediatrics, 97(4), 569-578.
Frank M. Magid Associates, Inc. (2006). From early adoption to common practice: A primer on online video. Online Publishers Association. Retrieved November 17, 2008 from http://www.online-publishers.org.
Gallagher, R. (2003). The next 20 years: How is online distance learning likely to evolve? Chicago, IL: 2003 UCEA 88th Annual Conference. March 28-30, 2003.
Gardner, F. E. M. (1992). Parent-child interaction and conduct disorder. Educational Psychology Review, 4, 135-163.
Ge, X., Natsuaki, M. N., Martin, D., Leve, L. D., Neiderhiser, J. M., Shaw, D. S., Villareal, G., Scaramella, L. V., Reid, J. B., & Reiss, D. (2008). Bridging the divide: Openness in adoption and post-adoption psychosocial adjustment among birth and adoptive parents. Journal of Family Psychology, 22, 529-540.
Gibbons, R. D., Hedeker, D., Waternaux, C. M., & Davis, J. M. (1988). Random regression models: A comprehensive approach to the analysis of longitudinal psychiatric data. Psychopharmacology Bulletin, 24, 438-443.
Gibbs, L. (2003). Evidence-Based Practice for the Helping Professions: A Practical Guide with Integrated Multimedia. Pacific Grove, CA: Brooks/ Cole.
Gordon, D. A. (2000). Parent training via CD-ROM: Using technology to disseminate effective prevention practices. The Journal of Primary Prevention, 21(2), 227-251.
Grant, T.R., Hawkins, A.J., & Dollahite, D.C. (2001). Web-based education and support for fathers: Remote but promising. In A.J. Hawkins & J. Fagan (Eds.), Clinical and educational interventions with fathers (pp.143-170). Binghamton, NY: Haworth Clinical Practice Press.
Greenberg, M. T., Domitrovich, C. E., Graczyk, P. A., & Zins, J. E. (2005). The Study of Implementation in School-Based Preventive Interventions: Theory, Research, and Practice (Volume 3). Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration.
Grotevant, H.D. (1997). Coming to terms with adoption: The construction of identity from adolescence into adulthood. Adoption Quarterly, 1(1), 3-27.
Grotevant, H.D., Dunbar, H.N., Kohler, J.K., & Lash Esau, A.M. (2000). Adoptive identity: How contexts within and beyond the family shape developmental pathways. Family Relations, 49(4), 379-387.
Grotevant, H.D., van Dulmer, H.M., Dunbar, N., Nelson-Christinedaugher, J., Christensen, M., Fan, X., & Miller, B.C. (2006). Antisocial behavior of adoptees and nonadoptees: Prediction from early history and adolescent relationships. Journal of Research on Adolescence, 16(1), 105-131.
Grotevant, H.D., Wrobel, G.M., van Dulmen, M.H., & McRoy, R.G. (2001). The emergence of psychological engagement in adopted adolescents: The family as context over time. Journal of Adolescent Research, 16(5), 469-490.
Gunnar, M.R., & Kertes, D.A. (2006). Prenatal and postnatal risks to neurobiological development in internationally adopted children. In D. M. Brodzinsky & J. Palacios (Eds.), Psychological issues in adoption. Westport, CT: Praeger.
Hague Conference on Private International Law, (2008). Outline: Hague Intercountry Adoption Convention (The Hague Convention of 29 May 1993 on Protection of Children and Co-Operation in Respect of Intercountry Adoption). The Hague: Hague Conference on Private International Law.
Haine, R.A., Sandler, I.N., Wolchik, S.A., Tein, J., & Dawson-McClure, S.R. (2003). Changing the legacy of divorce: Evidence from prevention programs and future directions. Family Relations, 52(4), 397-405.
Hall, J. L. & Jennings, Jr., E. T. (2006). Using best practices to inform state public policy decision-making. Paper presented at the annual meeting of the American Political Science Association, Marriott, Loews Philadelphia, and the Pennsylvania Convention Center, Philadelphia, PA.
Harachi, T.W., Catalano, R. F., & Hawkins, J. D. (1997). Effective recruitment for parenting programs within ethnic minority communities. Child and Adolescent Social Work Journal, 14(1), 23-39.
Harden, R. M. (2005). A new vision for distance learning and continuing medical education. Journal of Continuing Education in the Health Professions, 25 (1), 43-51.
Harwood, R. L., & Weissberg, R. P. (1987). The potential of video in the promotion of social competence in older children and adolescence. Journal of Early Adolescence, 3, 345-363.
Hasson, D., Anderberg, U. M., Theorell, T., & Arnetz, B. B. (2005). Psychophysiological effects of a web-based stress management system: A prospective, randomized controlled intervention study of IT and media workers. BMC Public Health 2005, 5 (78).
Hedeker, D., Gibbons, R. D., & Waternaux, C. (1999). Sample size estimation for longitudinal designs with attrition: Comparing time-related contrasts between two groups. Journal of Educational and Behavioral Statistics, 24 (1), 70-93.
Henderson, J., Noell, J., Reeves, T., Robinson, T., & Strecher, V. (1999). Developers and evaluation of interactive health communication applications. American Journal of Preventive Medicine, 16, 30-34.
Henney, S. M. (1995). Adoptive parent survey booklet supplement for the Texas/ Minnesota Adoption Research Project.
Hickman, C. J. (2003, March 29). Results of survey regarding distance education offerings. University Continuing Education Association (UCEA) Distance Learning Community of Practice, Research committee report.
Hodges, J., & Tizard, B. (1989). Social and family relationships of ex-institutional adolescents. Journal of Child Psychology and Psychiatry, 30, 77-97.
Horrigan, J. (2006). Home Broadband Adoption 2006. Pew Internet and American Life Project. Retrieved November 12, 2008, from http://www.pewinternet.org/pdfs/PIP_Broadband_trends2006.pdf.
Horner, R.D. (2000). A practitioner looks at adoption research. Family Relations, 49(4), 473-477.
Hutchings, J., Lane, E., & Gardner, F. (2004) Making evidence-based intervention work. In D. Farrington, C. Sutton, & D. Utting (Eds.), Support from the Start: Working with Young Children and their Families to Reduce the Risks of Crime and Antisocial Behaviour.
Imel, S. (1994). Guidelines for working with adult learners. ERIC Digest No. 154 (ERIC Document Reproduction Service No. ED377313, 1994-00-00).
Ingersoll, B. (1997). Psychiatric disorders among adopted children: A review and commentary. Adoption Quarterly, 1(1), 57-73.
Jaccard, J. J., & Davidson, A. R. (1972). Toward an understanding of family planning behaviors: An initial investigation. Journal of Applied Social Psychology, 2, 228-235.
Johnson, D. (2002). Adoption and the effect on children's development. Early Human Development, 68, 39-54.
Jones, L. B. (2007). Parenting through divorce: Phase I final report Eugene, OR: IRIS Media, Inc.
Jung, I. (2005). ICT-pedagogy integration in teacher Training: Application cases Worldwide. Educational Technology & Society, 8 (2), 94-101.
Kamel Boulos, M. N, & Wheeler, S. (2007). The emerging Web 2.0 social software: An enabling suite of sociable technologies in health and health care education. Health Information and Libraries Journal, 24 (1), 2-23.
Karchmer, R.A. (2000). Understanding teachers' perspectives of Internet use in the classroom: Implications for teacher education and staff development. Reading and Writing Quarterly: Overcoming Learning Difficulties, 16, 81-85.
Kazdin, A. E., & Wassell, G. (1999). Barriers to treatment participation and therapeutic change among children referred for conduct disorder. Journal of Clinical Child Psychology, 28, 160-172.
Kinley, E.R. (2001) Implementing distance education, the impact of institutional characteristics: A view from the department chair's chair. Unpublished doctoral dissertation, University of Nebraska, Lincoln.
Kirk, D. (1981). Adoptive kinship. Toronto: Butterworths.
Klesges, L. M., Estabrooks, P. A., Dzewaltowski, P. A., Bull, D. A., & Glasgow, R. E. (2005). Beginning with the application in mind: designing and planning health behavior change interventions to enhance dissemination. Annals of Behavioral Medicine, 29 (suppl), 66-75.
Kline, S. L., Karel, A. I., & Chatterjee, K. (2006). Covering adoption: General depictions in broadcast news. Family Relations, 55, 487-498.
Kochanska, G. (1997). Mutually responsive orientation between mothers and their young children: Implications for early socialization. Child Development, 68, 94-112.
Kohler, J.K., Grotevant, J.D., & McRoy, R.G. (2002). Adopted adolescents preoccupation with adoption: The impact on adoptive family relationships. Journal of Marriage and Family, 64(1), 93-104.
Koniak-Griffin, D., Lessser, J., Nyamathi, A., Uman, G., Stein, J., & Cumberland, W. (2003). Project CHARM: An HIV prevention program for adolescent mothers. Family & Community Health, 26, 94-107.
Krueger, R. A. (1994). Focus groups: a practical guide for applied research (2nd ed.). Newbury Park, CA: Sage.
Lagges, A., & Gordon, D. (1999). Use of an interactive laserdisc parent-training program with teenage parents. Child and Family Behavior Therapy, 21, 19-35.
Langan-Fox, J., Armstrong, K., Balvin, N., & Anglim, J. (2002). Process in skill acquisition: Motivation, interruptions, memory, affective states, and metacognition. Australian Psychologist, 37, 2 , 104-117.
Lansford, J.E., Ceballo, R., Abbey, A., & Stewart, A.J. (2001). Does family structure matter? A comparison of adoptive, two-parent biological, single-mother, stepfather, and stepmother households. Journal of Marriage and Family, 63(3), 840-851.
Lee, D., & Quintana, S. (2005). Benefits of cultural exposure and development of Korean perspective-taking ability for transracially adopted Korean children. Cultural Diversity and Ethnic Minority Psychology, 11 (2), 130-143.
Leve, L., & Ganiban, J. (Feb, 2009). Adjustment, Openness in Adoption, and Family Services: Findings from The Early Growth and Development Study. Presentation at the 2nd Annual Adoption Caseworker Forum, Tampa, FL.
Levy-Shiff, R. (2001). Psychological adjustment of adoptees in adulthood: Family environment and adoption-related correlates. International Journal of Behavioral Development, 25(2), 97-104.
Lin, Q. (2008). Student views of hybrid learning: A one-year exploratory study. Journal of Computing in Teacher Education, 25 (2), 57-66.
Mason, R., & Rennie, F. (2007). Using Web 2.0 for learning in the community. The Internet and Higher Education, 10, (3), 196-203.
Masten, A., & Coatsworth, J. D. (1998). The development of competence in favorable and unfavorable environments: Lessons from research on successful children. American Psychologist, 53, 185-204.
Matusov, E., Hayes, R., & Pluta, M. J. (2005). Using discussion webs to develop an academic community of learners. Educational Technology & Society, 8 (2), 16-39.
McRoy, R.G., Grotevant, H.D., Ayers-Lopez, S., & Furuta, A. (1990). Adoption revelation and communication issues: Implications for practice with adoptive families. Families in Society: The Journal of Contemporary Human Services, 550-557.
McRoy, R., Grotevant, H., & Zurcher, L. (1988). Emotional disturbance in adopted adolescents: Origins and development. New York: Praeger.
Merriam, S. B., & Caffarella, R. S. (1999). Learning in adulthood. San Francisco: Jossey-Bass.
Metzler, C. W. (2008). Incredible infants: Phase I final report. Eugene, OR: Oregon Research Institute.
Metzler, C. W., Seeley, J., & Marquez, B. (2008). Increasing Access to Early Parenting Education and Support Phase 1 (Rep. No. 1R41HD051184-01A1).
Miller, B.C., Fan, X., Christensen, M., Grotevant, H.D., & van Dulmen, M. (2000). Comparisons of adopted and nonadopted adolescents in a large, nationally representative sample. Child Development, 71(5), 1458-1473.
Moore, S. M., & Ohtsuka, K. (1997). Gambling activities of young Australians: Developing a model of behaviour. Journal of Gambling Studies, 13, 207-236.
Muthén, B. (1989). Multiple-group structural modeling with non-normal continuous variables. British Journal of Mathematical and Statistical Psychology, 42, 55-62. (#26)
National Association of Social Workers (2007). Social Workers: Helping Families in Crisis through Foster Care. Washington, DC: National Association of Social Workers. Retrieved March 10, 2009, from http://www.socialworkers.org/pressroom/2007/043007.asp
Neville, H. A., Lilly, R. L., Lee, R. M., Duran, G., & Browne, L. (2000). Color-Blind Racial Attitudes Scale (CoBRAS). Journal of Counseling Psychology, 47 (1), 59-70.
Nielsen/ NetRatings (2004). Three out of four Americans have access to the internet, according to Nielsen/NetRatings. Retrieved March 10, 2009, from http://www.netratings.com/pr/pr_040318.pdf
Nunnally, J. C. & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
Nurko, C. & Proffit, W. R. (2005). Acceptability and perceived effectiveness of web-based self-instruction in clinical orthodontics. Angle Orthodontist, 75, 521-525.
Oenema, A. ,Brug, J., & Lechner, L. (2001). Web-based tailored nutrition education: results of a randomized controlled trial. Health Education Research, 16 (6), 647-660.
Ojima, M., Hanioka, T., Kuboniwa, M., Nagata, H., & Shizukuishi, S. (2003). Development of Web-based intervention system for periodontal health: a pilot study in the workplace. Informatics for Health and Social Care, 28(4), 291-298.
Oldenburg, B. & Parcel, G. (2002). Diffusion of health promotion and health education innovations. In K.Glanz, B. Rimer, & F. Lewis (Eds.), Health Behaviour and Health Education: Theory, research, and practice (pp. 312-334). San Francisco: Jossey-Bass.
Olson, D. R., & Bruner, J. S. (1974). Learning through experience and learning through media. In D. R. Olson (Eds.). Media and symbols: The forms of expression, communication, and education. (pp. 125-150). The 73rd Yearbook of the National Society for the Study of Education: University of Chicago Press.
Palacios, J., & Brodzinsky, D. (2006). Recent changes and future directions for adoption research. In D. M. Brodzinsky & J. Palacios (Eds.), Psychological issues in adoption (pp. 257-268). Westport, CT: Praeger.
Pond, W. K. (2003). Lifelong Learning: The Changing Face of Higher Education. eLearning Summit, La Quinta Resort, California.
Priel, B., Melamed-Hass, S., Besser, A., & Kantor, B. (2000). Adjustment among adopted children: The role of maternal self-reflectiveness. Family Relations, 49(4), 389-396.
Proctor, C., Groza, V., & Rosenthal, J. (1999). Social support and adoptive families of children with special needs. Cleveland, OH: Mandel School of Applied Social Sciences, Case Western Reserve University.Retrieved March 10, 2009, from http://msass.case.edu/downloads/vgroza/003-1999.pdf
Quinton, D., Rushton, A., Dance, C. & Mayes, D. (1998) Joining new families: A study of adoption and fostering in middle childhood. Chichester, UK: Wiley.
Raudenbush, S.W. & Bryk, A.S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage Publications.
Robberecht, R. (2007). Interactive Nonlinear Learning Environments. The Electronic Journal of e-Learning, 5 (1), 59 - 68. Retrieved March 10, 2009, from http://www.ejel.org/Volume-5/v5-i1/Robberecht.pdf
Rodes, P. & Knapczyk, D. (2000). Involving teachers in web-based professional development. T.H.E.Journal, 27, 95-102.
Rosenshine, B. (1983). Teaching functions in instructional programs. Elementary School Journal, 83, 352.
Ross, M. W., & McLaws, M.-L. (1992). Subjective norms about condoms are better predictors of use and intention to use than attitudes. Health Education Research, 7 (3), 335-339.
Roye, C., & Hudson, M. (2003). Development of a culturally appropriate video to promote dual method use by urban teens: Rationale and methodology. AIDS Education and Prevention, 15, 148-158.
Rusby, J. C. (2002). Training needs and challenges of family child care providers. Child & Youth Care Forum, 31(5), 281-293.









