Executive functioning in TBI from rehabilitation to social reintegration: COMPASS goal, a randomized controlled trial (grant: 1I01RX000637-01A3 by the VA ORD RR&D, 2013–2016)
© Libin et al. 2016
Received: 8 August 2015
Accepted: 30 October 2015
Published: 30 November 2015
Traumatic brain injury is a major health problem that frequently leads to deficits in executive function. Self-regulation processes, such as goal-setting, may become disordered after traumatic brain injury, particularly when the frontal regions of the brain and their connections are involved. Such impairments reduce injured veterans’ ability to return to work or school and to regain satisfactory personal lives. Understanding the neurologically disabling effects of brain injury on executive function is necessary for both the accurate diagnosis of impairment and the individual tailoring of rehabilitation processes to help returning service members recover independent function.
The COMPASSgoal (Community Participation through Self-Efficacy Skills Development) program develops and tests a novel patient-centered intervention framework for community re-integration psychosocial research in veterans with mild traumatic brain injury. COMPASSgoal integrates the principles and best practices of goal self-management. Goal setting is a core skill in self-management training by which persons with chronic health conditions learn to improve their status and decrease symptom effects. Over a three-year period, COMPASSgoal will recruit 110 participants with residual executive dysfunction three months or more post-injury. Inclusion criteria combine both clinical diagnosis and standardized scores that are >1 SD from the normative score on the Frontal Systems Rating Scale. Participants are randomized into two groups: goal-management (intervention) and supported discharge (control). The intervention is administered in eight consecutive, weekly sessions. Assessments occur at enrollment, post-intervention/supported discharge, and three months post-treatment follow-up.
Goal management is part of the “natural language” of rehabilitation. However, collaborative goal-setting between clinicians/case managers and clients can be hindered by the cognitive deficits that follow brain injury. Re-training returning veterans with brain injury in goal management, with appropriate help and support, would essentially treat deficits in executive function. A structured approach to goal self-management may foster greater independence and self-efficacy, help veterans gain insight into goals that are realistic for them at a given time, and help clinicians and veterans to work more effectively as true collaborators.
KeywordsExecutive function Traumatic brain injury Goal-setting Community re-integration Veterans Randomized controlled trial Manualized psychosocial intervention
Registry: ClinicalTrials.gov Identifier - NCT01816061.
Trial registration data set
Primary registry and trial identifying number
Date of registration in primary registry
March 19, 2013
Secondary identifying numbers
Source(s) of monetary or material support
United States Department of Veterans Affairs Rehabilitation Research and Development Service
United States Department of Veterans Affairs Rehabilitation Research and Development Service
Contact for public queries
AVL [Alexander.Libin2@va.gov], ED [Ellen.Danford@va.gov]
Contact for scientific queries
Executive Functioning in TBI from Rehabilitation to Social Reintegration: COMPASS
Executive Functioning in TBI from Rehabilitation to Social Reintegration: COMPASS
Countries of recruitment
United States of America
Health condition(s) or problem(s) studied
Experimental—Fifty-five participants in the intervention group will receive eight goal self-management sessions. Control—Increased hours of patient-provider interactions.
Key inclusion and exclusion criteria
Ages eligible for study: 18–55 Sexes eligible for study: Both Accepts healthy volunteers: Yes Inclusion and Exclusion Criteria: See Table 2.
Interventional Allocation: Randomized Intervention Model: Parallel assignment Masking: Single blind (outcome accessor) Primary Purpose: Treatment Phase 0
Date of first enrollment
Target sample size
Change in Baseline in CRIS assessment at 2 months and 5 months. Change in Baseline in FrSBe assessment at 2 months and 5 months.
Key secondary outcomes
Issue Date: 21 Aug 2015
Protocol Amendment Number: 06
Author(s): AVL, JS, MMS, ED, NS, WP, JG, LR, DB, SC, MP, BT, MB, AD.
Revision Chronology (Institutional Review Board (IRB))
27 Jan 2014 Original.
08 Aug 2014 Amendment 01: Primary reason for amendment – Submission of COMPASSgoal manual; updated recruitment procedures; addition of study staff.
24 Sep 2014 Amendment 02: Primary reason for amendment—Updated assessments to reflect DSM-V .
11 Dec 2014 Amendment 03: Primary reason for amendment—Updated assessments based on access issues; clarified control group protocol; changes to consent forms; addition of study staff.
26 Jan 2015 Amendment 04: Primary reason for amendment—Updated manual and consent forms, addition of study staff.
01 Apr 2015 Amendment 05: Primary reason for amendment—Updated recruitment flyers; addition of retention letters.
21 Aug 2015 Amendment 06: Primary reason for amendment—Removal of assessment; updated consent forms; addition of recruitment brochure.
Roles and responsibilities
AVL conceived of the study. JS, MMS, NS, WP, MP, BT, MB, and AD participated in the initial study design, and AVL, JS, MMS, ED, DB, and SC led the implementation of the study. NS guided statistical implementation and is conducting primary statistical analysis. All authors contributed to the refinement of the study protocol and edited and approved the final manuscript.
Sponsor contact information
Trial Sponsor: United States Department of Veterans Affairs Rehabilitation Research and Development Service.
Contact Name: Patricia Dorn, PhD
Address: 810 Vermont Avenue, NW (10P9R)
Washington, DC 20420
Sponsor and funder
This funding source reviewed the study design prior to implementation but will have limited to no role during its implementation, data analysis, and results publication.
No committees are involved in the execution of this study.
Background and rationale
There is mounting evidence that suggests that executive dysfunction due to central nervous system (CNS) insult causes both short-term and long-term consequences, resulting in poor goal-directed behavior [3, 5–8] and significant decreases in independent functioning in both soldiers and returning veterans. Given the necessity for operational effectiveness in the battlefield environment, executive function symptoms become significant for the military because they jeopardize active duty troops’ capacity for crucial decision making [9, 10]. At the same time, while remaining undetected, neurological problems cause poor self-management skills, resulting in maladjustment and a low quality of life in returning military veterans [3, 11, 12]. In this study, we employ the definition of TBI by the U.S. Individuals with Disabilities Education Improvement Act of 2004, i.e., “…an acquired injury to the brain caused by an external physical force, resulting in total or partial functional disability or psychosocial impairment, or both, that adversely affects a person’s professional and educational performance in one or more areas, such as cognition; language; memory; attention; reasoning; abstract thinking; judgment; problem-solving; sensory, perceptual, and motor abilities; physical functions; information processing; and speech. The term does not apply to brain injuries that are congenital or degenerative, or to brain injuries induced by birth trauma .” The exposure to stressors from combat, including explosive blasts and loss or injury to the self or to comrades, can lead to significant problems when transitioning back to civilian life post-combat [14, 15]. Due to advances in medicine and body armor, soldiers are surviving blasts or explosions that may have previously resulted in severe injury or death during combat. Following the U.S. defense causality report in November 2009, the Institute of Medicine updated its statistics to show that “fatality-to-wounded ratios have been 1:5.0 for… [conflict in Afghanistan] and 1:7.2 for…[conflict in Iraq] [14, 16] compared with 1:2.6 in Vietnam and 1:1.7 in World War II [14, 17].”
Many veterans returning from the wars in Afghanistan and Iraq may have experienced TBI , the significance of which is underscored by a national study undertaken by the RAND (Research ANd Development) Corporation commissioned by the U.S. Office of the Secretary of Defense for Health Affairs to gauge the effect of TBI on the lives of veterans and their families . Even if there are no other co-existing physical impairments, TBI and post-traumatic stress disorder (PTSD) are enough to significantly hinder a veteran’s successful progression into active community participation and employment. Physical factors affecting community re-integration in veterans with polytrauma and TBI include pain, PTSD-related anger, and depression. Among the psychosocial factors that affect community functioning in returning veterans are social isolation, poor problem-solving of everyday difficulties, and a lack of motivation to change.
Executive functioning system in TBI: a multifactorial model
Executive dysfunction is the core condition underlying neurologic impairments resulting from CNS insult, such as TBI , dual TBI-spinal cord injury , and stroke , and it is a distinct feature of CNS degenerative disorders such as Parkinson’s disease . As a central clinical syndrome, executive functioning is defined as a network of processes that are responsible for initiating, guiding, and regulating psychomotor, cognitive, emotional, and behavioral functions, particularly during active and novel problem-solving [7, 22, 23].
Recent studies emphasize that executive processes do not have a single neuroanatomical representation in the CNS [6, 30]; rather, they present as patterns that merge different brain structures (e.g., the brain’s prefrontal zone and limbic system) and their peripheral counterparts (e.g., motor apparatus). Existing interlinkages in the brain-peripheral system are currently explored by measuring various aspects of executive functioning through standardized neuropsychological assessments, magnetic-resonance imaging and a more precise assessment, diffusion tensor imaging . The conceptual definition of the EFS proposes two major subsystems: the central executive subsystem , which includes higher-level processes, such as selective attention, working memory, and decision-making capacity , and the peripheral executive subsystem, composed primarily of psychomotor processes associated with central executive performance [33, 34]. Executive functioning can break down at any stage in the behavioral sequence, be it volition control, planning, purposeful behavior, or effective performance . Deficiencies in self-initiated behaviors may result from neurological damage to the frontal-subcortical or fronto-limbic circuitry (see areas C and D, Fig. 2) [36, 37], to the right hemisphere, or in diffuse neurologic conditions (see area A, Fig. 2) . The dorsal prefrontal cortex is critical to allocating attentional resources involved with working memory tasks  or to the attentional controller  – a system responsible for maintaining and switching attention .
Motor performance is an instrumental component of the EFS [33, 34]. In the classic methodology of motor examination tasks developed by Luria and his successors [41, 42], the ability to copy hand movements paced by a metronome  was found to be sensitive to frontal damage and to temporal lesions (see area C, Fig. 2). The inability to move rapidly through a repetitive or mixed-movement sequence, combined with errors and perseverations, was found to be characteristic of patients with left hemisphere lesions (see area B, Fig. 2) . Motor regulation deficits are often associated with withholding responses , based on a “go/no-go” rule, in which a subject should respond to only one of two presented signals (see area A, Fig. 2) .
Patients with subcortical involvement display executive dysfunction that includes impairments in cognitive flexibility, memory recall, and psychomotor slowing [46–48]. Impairment of executive processes often presents a major challenge in an individual’s ability to perform activities of daily living , to manage their disability , and to reintegrate into the community .
Executive System: TBI, PTSD and community re-integration
There is an overlap of symptoms between TBI and PTSD. This issue is most pertinent in the chronic TBI population, where there are higher rates of PTSD. Sustaining any type of physical injury is known to increase a person’s risk for PTSD . There are several symptoms that are found in both PTSD and TBI, such as deficits in attention and memory, irritability, and sleep disturbance. However, in the acute assessment of TBI, distinguishing symptoms such as headache, dizziness, balance problems, and nausea/vomiting may help distinguish TBI from PTSD. Another distinguishing factor is the history that is obtained from patients about the course of events before, during, and after the traumatic event. Loss of consciousness and post-traumatic amnesia are less common in PTSD and is the distinguishing historical factor to diagnose mild and moderate TBI.
Research has suggested a range of post-injury cognitive, somatic, and behavioral symptoms, including headache, anxiety, dizziness, and memory difficulties immediately following TBI [47, 53, 54] and decreased educational attainment and limitations in work performance [55, 56]. The effects of cognitive and behavioral impairment on independence and societal participation following TBI are well established. At the same time, the gaps between research and everyday life continue to exist. A U.S. Institute of Medicine report on the needs of veterans returning from Afghanistan and Iraq indicates, “little research has been conducted to evaluate whether service members who undergo third location decompression (that is, for service members to have time with their comrades and peers in a restful situation and prepare themselves for going back to their families and communities) have better outcomes than those who do not .”
Strengthening the community integration of veterans with TBI requires a collaborative effort bringing together veterans and their families, Veterans Health Administration (VHA) case managers and social workers, and the broader research community to address barriers that prevent veterans with serious injures such as TBI from effectively pursuing life opportunities that are available to others. In one of the first national surveys of veterans in Afghanistan and Iraq enrolled in the Department of Veterans Affairs (VA) health care system who saw combat, Sayer and colleagues (2010)  explored the prevalence and types of community re-integration problems veterans faced and assessed preferences for interventions to promote adaptation to civilian life. Stratified Poisson regression was used to determine whether the number of community reintegration problems and the number of services of interest were associated with the presence of probable PTSD, gender, or race. An estimated 25 % to 56 % of the population had some difficulty to extreme difficulty in the social functioning, productivity, community involvement, and self-care domains. At least one third reported divorce, dangerous driving, increased substance use, and anger control problems since returning from deployment. An estimated 41 % had probable PTSD, and each type of reintegration problem was more prevalent among veterans with probable PTSD. The vast majority (96 %) of Afghanistan/Iraq veterans expressed interest in services to help them readjust to civilian life. The most commonly preferred ways to receive reintegration service or information was at a VA facility, through the mail, and over the internet. Interest in self-help techniques and yoga/meditation was particularly common . Penk and colleagues (2010) , in their VHA comparative effectiveness study, discussed the need for research that identifies ways to aid veterans with dual diagnoses attain competitive jobs. Community re-integration tools were found to be key to the effectiveness of employment programs providing veterans not only with income-earning work but also with skills to help them secure employment.
International classification of function, disability, and health (ICF)
In the Community Participation through Self-efficacy Skills Development: COMPASSgoal study, we consider function and disability, as well as activity and participation (including employment), based upon the widely used ICF framework  developed under the auspices of the World Health Organization. Through this inclusive approach, the study team documents the natural process of recovery in TBI, including the occurrence of accelerated recovery, thereby addressing the needs of people with chronic TBI and providing potential benefits. At each assessment time point, participants (and their families and/or caregivers, if appropriate) will complete validated, standardized scales that capture outcomes in four central domains, as defined by the ICF model: function, health, participation, and employment. The ICF presents an interaction of several basic concepts in disability that is widely used as a methodological tool for studying physical disability in general and TBI in particular. Relevant to the present project’s conceptual integration is the ICF proposed model of contextual (personal and environmental) factors as they relate to the individual health condition .
COMPASSgoal conceptual framework
COMPASSgoal aims to address the unmet needs of veterans of conflicts in Afghanistan and Iraq for successful return to civilian life [9, 11, 14, 15]. Employing the proven elements from self-management training and other goal-management programs successfully implemented with civilian clinical populations, COMPASSgoal guides participating veterans, their families, and interventionists through the process of negotiating goals, establishing hierarchies of long-, mid-, and short-range goals, and developing individualized, measurable ways of tracking progress. A skill that is emphasized is the ability to break distal, or long-term, goals into proximal or short-term goals and to use one’s performance on proximal goals to modify the distal ones as necessary . Other specific components incorporated into the COMPASSgoal protocol include three over-arching self-regulation strategies that have been shown in meta-analyses to be effective: goal manipulations, arousal management (both relaxation and increasing arousal/motivation), and cognitive self-regulation, which includes self-monitoring, evaluating, and adjusting performance to meet a selected standard . A meta-cognitive technique called “mental contrasting”—simultaneously considering both the positive aspects of the goal state and the negative aspects of one’s current state— is also employed . Finally, self-monitoring skills are incorporated because these also have a strong evidence base .
Choice of comparators
Interdisciplinary care is essential to TBI rehabilitation. Per VA guidelines, many veterans receiving care for TBI-related problems are also followed by a case manager and an interdisciplinary team [11, 64]. As part of this care, veterans frequently answer the Mayo-Portland Adaptability Inventory—4 Participation Index (M2PI) . The test is a self-report by the person with TBI. The M2PI is currently used by the Washington DC VA Medical Center (DC VAMC) TBI clinic team when the veteran is initially evaluated in a team meeting, when the veteran is discharged from team treatment, and three to six months post-discharge. Thus, the administration of the M2PI mimics interactions with a case manager. The M2PI functions as a checklist for the research team and fulfills the role of increased interactions with a case manager. It encourages veterans to reflect upon their community integration and offsets the possible effects of the additional time and attention devoted to participants in the COMPASSgoal group models.
The main objective of the COMPASSgoal study is to determine whether veterans who have executive dysfunction due to mild traumatic brain injury (mTBI) will benefit from a novel goal self-management intervention, COMPASSgoal, compared to veterans who receive case management support that represents the current standard of care enhanced by an increased number of communications with VA staff.
Study Specific Aim 1: To develop, implement, and evaluate a new goal self-management intervention (COMPASSgoal) for veterans with executive dysfunction due to mTBI and to investigate how executive functioning is linked to the performance of everyday tasks and community functioning.
Study Hypothesis 1: Participants in the COMPASSgoal group will have higher community integration scores over time than participants in the supported discharge group matched on executive dysfunction score.
Study Hypothesis 2: Individuals’ psychosocial profiles (emotional status, resilience, and level of PTSD) will mediate the responsiveness to the COMPASSgoal intervention, measured through standardized experimental performance of everyday tasks, in veterans with impaired executive function due to mTBI.
The COMPASSgoal study is designed as a randomized, controlled, single blind (outcome accessor) efficacy study with two parallel groups. The primary endpoint of the study occurs with final data collection at time point three, three months after the completion of either group. Participants will be randomly assigned to either control or experimental groups with a 1:1 ratio based on Wei’s Urn randomization algorithm . Over the three-year course of the COMPASSgoal project, we will screen, consent, and baseline 110 veterans, aged 18–55 years, who have been diagnosed with mTBI. All participating veterans undergo a battery of tests measuring executive function, real-world performance, TBI self-efficacy, emotional status and PTSD, community integration, and quality of life. Each potential participant receives additional screening of TBI and executive dysfunction to determine intervention eligibility. Each participant also receives a neuropsychological interview, and COMPASSgoal investigators discuss each participating veteran with his/her VA case manager, as applicable. Subsequently, veterans are randomized to intervention and control groups. The former receives the COMPASSgoal self-management intervention developed to support vulnerable transitions identified during the first 6 months of the project. The latter receives focused, but standard-of-care, support from the VA TBI Research team. Intervention-group veterans receive weekly eight one-on-one goal management sessions of up to 90 minutes over a period of two months. Veterans in both the intervention and control groups receive assessments before, directly following, and three months following the completion of the COMPASSgoal intervention or supported discharge process. The data will be modeled longitudinally and on multiple levels to identify vulnerable transitions and predictors of community integration/participation outcomes. The findings will form the basis for clinical practice guidelines.
The three-year, multi-phase study explores two inter-related hypotheses. Hypothesis 1 is explored through a randomized controlled trial (RCT) that tests the efficacy of a newly developed intervention, COMPASSgoal, in 110 young to middle-aged veterans with mTBI assigned to intervention goal self-management or supported discharge groups. Hypothesis 2 is aimed at studying the multilevel relationships between four sets of variables (neurological, psychological, behavioral, and social) measured repeatedly for the duration of the project.
Participants, interventions, and outcomes
We make every effort to balance the sample by age, gender, and education following the study inclusion–exclusion criteria. Based on previous studies conducted with the VA population in the Greater Washington DC Metropolitan Area, we expect that approximately 10 % of the study participants will be female, and 70 % will be African-American. The total number of study participants (N = 110) accounts for a 20 % attrition rate in a neurologically disabled population due to their health condition and related problems.
COMPASSgoal Inclusion and exclusion criteria
COMPASSGOAL: community re-integration study
TBI of at least mild severity using criteria related to disturbance of consciousness (VHA TBI Comprehensive Evaluation screening tool) 
Inability to provide informed consent and no proxy available
Obtained informed consent
Severe impairment of language or day-to-day memory that would preclude participation in a verbal-based therapy
Males or females of working age, between the ages of 18 and 55
Life expectancy of less than 36 months
Medically stable with physician approval to participate
Severe multiple trauma (judged by the attending physicians and/or investigators as too severe for participation in this study), such as severe burns, serious organ damage, amputations, or multiple fractures
Ability to comprehend and communicate in English at a 6th-grade level
History of substance abuse severe enough to cause neurologic damage, pre-morbid history of neurologic disease (e.g., stroke)
Prior history of known bipolar disorder or schizophrenia or severe psychiatric illness as confirmed by medical records and/or clinical judgment or M.I.N.I. assessment [69–72] if no clinical judgment is on record
The severity of TBI will be determined by the DC VAMC attending clinician using the VHA TBI Comprehensive Evaluation electronic template, questions 6–8 . Prior diagnosis by the attending physician through the electronic template will be confirmed through a review of medical records or an interview with the attending physician upon enrollment in the study. The FrSBe is used to identify individuals with differing levels of executive dysfunction. The operational definition of executive dysfunction/inclusion into the study is based on both clinical diagnosis by a study physician and a standardized executive dysfunction measure, the FrSBe score, such that a total score or any of the 3 subscale scores >1 SD compared to the normative score would indicate executive dysfunction sufficient to include in the study . Prior history of known bipolar disorder, schizophrenia or severe psychiatric illness are determined first by a review of the medical history, and in the absence of clinical psychiatric assessment, the M.I.N.I. International Neuropsychiatric Interview (M.I.N.I.) assessment is completed by study staff. The M.I.N.I. has demonstrated reliability and validity compared to structured clinical interviews [69–72]. We believe both methods will adequately screen potential participants for possible severe mental health confounders.
For purposes of this study, the interventionist will be a Master’s level case worker who completed training regarding the military population with practicing psychologists, case managers, and physicians. We selected the interventionist to ensure that the COMPASSgoal manual could be utilized by clinicians of diverse training levels, following initial testing.
The research staff underwent intensive training during months 9–11 of Year 1 and received ongoing relevant education. The principal investigators assume the responsibility of supervision of the COMPASSgoal staff involved with intervention delivery and also provide mentoring regarding specific medical, family, and community issues as needed. Initially, daily meetings among the research team will be held to address operational, procedural, and scheduling issues. Staff meetings take place weekly to address difficult cases and to share successful management strategies and new resources.
To successfully implement the proposed intervention as a complementary service to participating veterans with TBI, the study staff employs the framework developed in the VHA Handbook  1172.04, Physical Medicine and Rehabilitation: Individualized Rehabilitation and Community Re-Integration Care Plan (2010). This VHA Handbook defines procedures for development and implementation of the Individualized Rehabilitation and Community Reintegration Care Plan for veterans and Military Service members who receive inpatient or outpatient rehabilitative care for functional deficits or needs related to TBI and polytrauma. The COMPASSgoal protocol interplays at each phase of development and implementation with the procedures for Individualized Rehabilitation and Community Re- Integration Care Plans specified by the VHA Handbook and carried out at the DC VAMC.
Aim 1 includes the development and implementation of an innovative treatment program, COMPASSgoal, to mentor veterans with executive dysfunction due to mTBI in evidence-based techniques for implementing goal self-management. This process is guided by a systematic, written protocol, a COMPASSgoal manual for interventionists, and patient-friendly materials customizable to support individual treatment of veterans with mTBI who participate in the study. The COMPASSgoal manual guides interventionists in the process of working with veterans with mTBI to define and track progress towards goals throughout the study timeframe.
Prior to the finalization of the COMPASSgoal manual, focus groups and semi-structured interviews were held with veterans with mTBI from a variety of backgrounds and with VA clinicians from practice areas such as case work, occupational, physical, speech, and recreation therapy and psychology and counseling, representative of how the VA delivers services nationwide. The purpose of these interviews and focus groups was to assure that the content and format of the COMPASSgoal intervention was broadly relevant to both veterans’ goals in the context of their lived experiences and to the guidelines of clinicians’ practice across VA service environments. Interviews and focus groups were completed from March-August 2014.
Intervention and supported discharge group
Veterans are randomized to the intervention or control groups. The former receives the COMPASSgoal self-management intervention developed to support vulnerable transitions identified during the recruitment assessment and interviews/focus groups. Each client in the intervention group receives up to 90 minutes per week of treatment either face-to-face or over the phone, which follows the written protocol (COMPASSgoal Manual). This treatment is conducted by trained research staff. Studies have shown the effectiveness of both telephone and face-to-face administration of psychosocial and rehabilitative interventions [73–76]. Because the COMPASSgoal intervention is experimental, there are no data to show that the two approaches are comparable for this specific intervention. However, care is often delivered at a distance in the VA system through various modes of telemedicine, due in part to distance barriers . Hence, diverse care delivery practices are increasingly normative in the study population. We anticipate comparable effectiveness for those receiving the intervention remotely and face-to-face, but we acknowledge that differences may arise, and the modalities will be analyzed as a separate variable.
In the course of weekly sessions, each client develops his or her goal planner. The planner is conceived as a portfolio that contains the written materials generated during goal planning with various tabs for long- mid-, and short-term goals and activities related to them, and all materials are designed collaboratively with each client for goal tracking. Depending on the individual client’s comfort with and access to technology, the materials are managed online through a secure portal. The goal planner is updated weekly during intervention sessions.
Goal sessions with coaches are audiorecorded to better inform the researchers about the effectiveness of the interventions. Significant others (spouses or other close friends/relatives) are invited to participate in the assessments and the sessions at the discretion of each participating veteran to provide support outside of treatment for implementing the procedures learned in each session.
Participants randomized into the supported discharge group serve as controls for the intervention group and do not receive the COMPASSgoal intervention. Each control group participant receives additional prompts to address just-in-time concerns, as documented in their treatment plans. This strategy results in the increased frequency of phone calls and other means of contact. Veterans enrolled in the control group are contacted by the study team every two weeks over the eight-week period, corresponding with their counterparts randomized to the intervention arm. During the point of contact, the veteran in the supported discharge group answers the M2PI . The M2PI is administered either through a secure online portal or over the phone. These interactions are audiorecorded.
Modifications, adherence & concomitant care
Participants in either group are free to discontinue participation any time. The principal investigator may need to end an individual’s participation before completion if it is deemed appropriate or in their best interest. To improve adherence to the intervention, participants who fail to attend intervention appointments are called three times to follow up on continuation in the study. After the third attempted phone call, a letter is mailed to the participant’s address asking him or her to contact the study team. If no response is received, the participant’s enrollment in the study is terminated. Letters are also sent between the second and third assessment sessions as a reminder of the upcoming assessment appointment and upon completion of the study.
Veterans who are currently evaluated at weekly meetings by the DC VAMC Polytrauma Interdisciplinary team for TBI-related skilled therapy management are not enrolled in the study until evaluation at team meetings has been completed.
COMPASSgoal outcomes, the result of hypothesis testing on collected data, hinge on the assessment of variables measuring veteran well-being and community integration pre-and post-intervention, with 3 month follow-up post-intervention. When assembling the study assessment battery, we considered the following rules: a) the relevance of the measure to the study’s specific aim and hypotheses; b) the balance of the proposed measures by modes of expression and assessment quality (self-reported assessment versus experimental technique versus observation by a clinician or a family member); c) the possibility of premorbid (e.g., pre-injury that resulted in mTBI) executive functioning evaluation and sequential charting of executive function over time as it returns to the standardized norm; and d) the possibility of linking performance at the baseline with executive performance over time, using reliable change models to determine whether the change meets the criteria for some a priori “recovery threshold.”
COMPASSgoal assessment battery
Cognitive functioning and TBI severity
VHA TBI Comprehensive Evaluation screening tool 
This is a reliable measure for detecting cognitive impairment in service members. If the veteran does not have a CTBIE available in the medical record, questions 6–8 will be collected by an IRB-approved member of the Polytrauma team.
Patient Information Form
8 questions about demographics
This is a reliable measure of mental disorders from DSM-V.
46-items. Both self-report and family-report.
Exclusionary screening, T2, and T3
This is a measure of cognitive processing speed, mental sequencing, visual search and motor speed that consists of two components: Part A and Part B. Part A requires the subject to connect 15 encircled numbers that are randomly arranged on a page in numerical order. Part B requires the subject to connect 15 encircled numbers and letters in alternating order. The score provided is the time required to complete the task.
T1, T2, and T3
This is a measure of word generation and is considered an executive functioning measure. Letter fluency requires the person to generate words that start with a specific letter. Each trial lasts one minute, and the score is based on the number of words provided.
T1, T2, and T3
PTSD-related functional impairment
Brief Inventory of Psychosocial Functioning (B-IPF) 
The B-IPF is a 14-item self-report instrument that measures functional impairment across several domains, including self-care, intimate relationships, familial relationships, work, friendship and socializing, parenting, and education. Each domain is composed of two questions. The first asks respondents to rate how much difficulty they have experienced in a domain during the past 30 days. The second question asks respondents to rate the amount of distress they have experienced related to those difficulties during the past 30 days.
T1, T2, and T3
TBI Self-efficacy Questionnaire 
A 15-item TBI-specific scale of self-efficacy with regard to trauma to measure individual abilities to manage TBI consequences.
T1, T2, and T3
Emotional status and resilience
A paper-and-pencil scale that consists of 18 items to measure depression, anxiety, somatic concerns, and general distress. It is a 5-point rating scale and is part of the CDE set.
T1, T2, and T3
Post-traumatic Stress Disorder Checklist for DSM-V (PCL-V) 
The presence of PTSD symptoms. PCL-V is a 20-item self-report scale updated for the DSM-V to measure stress signs, intrusive thoughts, avoidance, behavior, and arousal symptoms.
T1, T2, and T3
107 veteran-specific items assessing extent of participation, perceived limitation in participation, and participation satisfaction
T1, T2, and T3
Social participation via ICF qualifiers: Return to work and/or to school as defined by the ICF framework 
Work status/educational attainment confirmed by a family member/immediate caregiver or another reliable source
T1, T2, and T3
The purpose of the test is to explore the personal meaning of drawings made as a response to 15 standardized verbal concepts 12.
T1, T2, and T3
Global measure of well-being and life satisfaction
Satisfaction with Life Scale (SWLS) 
Self-report based on a 5-item scale
T1, T2, and T3
In accordance with the study’s specific aims, we also considered psychosocial individual assessments that capture the subjective aspects of recovery, including executive functioning [68, 78–83], amount of stress (PTSD) , functional capacity [20, 85], emotional status (including depression and anxiety levels) [86–90], TBI self-efficacy , coping , community integration [93–95], and life satisfaction . These measures have proven external validity and are commonly used in TBI studies (see Table 3). The behavioral assessment focuses on individuals’ performance of real-world tasks . The community integration measures focus on different aspects of societal participation and individual productivity, including educational attainment and employment [93, 94]. These measures also have good construct validity and test-retest reliability, and importantly, they are sensitive to change. Most measures employ alternate forms or demonstrate a low practice effect, which makes them appropriate for repeated administration. We are also aware that the types of measures included are complementary, such that “recovery” on the objective measures might not reflect “recovery” on the subjective measures.
Following consent procedures, individuals agreeing to participate in the study are asked a series of screening questions to ensure that they meet all inclusion/exclusion criteria. The first data collection takes place within the first 14 days after screening and enrollment into the project and is described in full in the Outcomes section. Veterans will be contacted by the study interventionist or supported discharge group leader within 7 days of completing the first assessment session, following randomization. Follow-up assessment sessions will be collected approximately 8–10 weeks after randomization, upon completion of either group, and 5 months after randomization (see Fig. 3).
The selection criteria focus on veterans with mTBI such as those who are routinely seen at the TBI clinic at the DC VAMC. The sample size calculations are based on a t-test for comparisons of mean change in the Community Reintegration of Service Members (CRIS) subscale, one of the primary outcome measures, from pre- to post-intervention between two groups.
Power Analysis and Sample Size Software (PASS)  was used for the power calculation. The primary outcome of this study is the frequency of social interactions measured via the Extent of Participation subscale of the CRIS [94, 95]. The power calculation was performed based on the hypothesis listed above using a two-sided t-test with the assumption of normality. The level of significance was set at 0.05, and the power was set at 90 %. The effect size and standard deviation used for the power calculation were estimated based on the VA study . Forty-four subjects in each group, for a total of 88 subjects, provided 90 % power to test an effect size of 0.71 with an SD of 7 for the difference in the CRIS subscale scores between groups, with α = 0.05 (two sided). After adjusting for 20 % loss to follow-up, we will recruit 55 subjects in each group of this study for a total of 110 subjects.
Participants are recruited from the DC VAMC at least three months after sustaining a TBI. Consecutive patients ramping down from multi-disciplinary care who meet the inclusion/exclusion criteria are notified of the study and approached for informed consent. Participants are also recruited using recruitment flyers, brochures, and letters. COMPASSgoal project team members participate in VA TBI clinic weekly meetings to discuss potential participants, i.e., veterans ramping down from multidisciplinary care, to approach for informed consent.
Assignment of interventions
Participants are randomly assigned to either control or experimental groups with a 1:1 ratio (105 + 105) using a computer-generated randomization list based on Wei’s Urn randomization algorithm. This algorithm is used to randomize subjects to two or more treatment groups of equal sizes. Wei’s Urn randomization algorithm dramatically changes the group assignment probabilities based on the degree of imbalance to achieve a longitudinal balance between groups . Randomization list was obtained using PASS .
Participants are randomized by the research coordinator. Allocation concealment is ensured as the randomization list is maintained in a secure, locked folder and accessed only upon completion of T1 assessments. The coordinator is unable to see the next participant’s assignment until the participant is ready for randomization.
A randomization list was developed by the biostatistician, for use after baseline assessments are complete. The coordinator receives the randomization list from the biostatistician and keeps it in a secure location. Upon completion of assessments, the coordinator reveals information about group allocation to the study participant and relevant study staff providing services in either group. Staff members responsible for future data collection are not allowed to receive information about the group allocation. Thereby, randomization will be completed without influence from data collectors or statisticians.
Staff members performing all outcome assessments are blinded to group assignment throughout the study, and participants are asked at each assessment not to reveal their group assignment to data collectors. In spite of these precautions, data collectors may become unmasked by a remark made by a participant during an assessment or an error made by the study staff. To document such occurrences, data collectors complete the Data Collector Estimation of Treatment Condition Form on which they (a) check off whether they have been unmasked and (b) indicate which group they think the participant was assigned to, if they believe they are unmasked.
We do not anticipate any situations that would require emergency unblinding because the study data collector does not provide clinical care for participants.
Data collection, management, and analysis
Data collection methods
The assessments are outlined further in Table 3. The data collector prepares all necessary questionnaires in packet form prior to each assessment session. All questions are read to the participants and significant others, and their answers are recorded by the data collector. No instruments are self-administered for this study. Participants are provided with a copy of questions and corresponding responses so that they can easy follow along with the interview.
To ensure study retention, the team uses a motivational technique that has proven useful in participant recruitment and retention. An Institutional Review Board (IRB) approved Certificate of Participation template issued to express appreciation to participants and family members for participating in the study in comprehensible, “layman” language. This approach will not only keep participants engaged with the study but will also potentially create a study atmosphere that will motivate them to bring other potential participants to the study to benefit from the same experience. To encourage ongoing patient engagement between assessment sessions T2 and T3, veterans receive IRB-approved Engagement Templates as reminders of their COMPASSgoal participation. This outreach technique reminds participants that they are enrolled in the COMPASSgoal study without providing information that may influence study variables.
Study information management procedures protect the privacy and confidentiality of individually identifiable participant information. Handwritten notes of study personnel are kept in locked file cabinets in researchers’ offices at the DC VAMC. Data from primary source documents are entered and managed in a secured database and are regularly reviewed for quality and completeness by the study coordinator. The data are analyzed through SPSS IBM, v.21.0  on a VA Informatics and Computing Infrastructure (VINCI) server . If data are downloaded from VINCI to share with non-VA collaborators, the data are de-identified. VINCI is used to upload and store data, but no data are requested from the national databases supplied through VINCI. Files are maintained in accordance with the Records Control Schedule.
Electronic data entry forms reflect primary source documents to facilitate accurate data entry. Trained study staff enter data immediately following collection. Data integrity will be maintained through validation rules and calculated fields. Coding sheets are available for each assessment entered into the database to confirm the correct coding of non-numeric data. Periodically, 10 % of the data is checked by the study PI or a designated official to ensure proper data entry. High error rates will require more investigation of data entry procedures. All data will be analyzed for errors prior to analysis.
For this project, we collect three major types of data assessed at times 1–3 (baseline/pre-intervention, post-intervention/supported discharge, and at three months post-treatment follow-up): community integration parameters, including educational attainment and employment and individual characteristics such as PTSD; TBI self-efficacy, emotional status, and coping, including resilience, performance of real-world tasks, and life satisfaction; and neuropsychological parameters, including overall cognitive and executive functioning. The primary outcome is a change in the three major types of parameters from pre- to post-intervention. Depending upon the hypothesis being tested (see Background: Objective, Specific Aim, and Hypotheses), participants are stratified according to their level of executive functioning, their severity of conditions secondary to TBI (e.g., PTSD, emotional status), or their degree of social participation. Dependent variables include TBI-self-efficacy, community integration indices, educational or work attainment as defined by the ICF qualifiers, and life satisfaction. Both objective (e.g., executive performance) and subjective (e.g., perceived TBI self-efficacy) data are then obtained based on repeated measures over the enrollment period. Multiple regression models will be fitted to explore continuous primary and secondary outcomes differentiating groups at each time point and changes at the intra-individual and inter-individual levels over time. For categorical outcomes (e.g., low/high executive performance or work status, such as unemployed/employed or part-time/full-time), unconditional logistic and/or multinomial regression models will be implemented.
The basic testing of the hypotheses will involve an Analysis of Variance (ANOVA) test and a repeated-measures ANOVA test. Bonferroni adjustments will be made to account for multiple testing.
Hypothesis 1: outcome variables main effects for community re-integration factors
This algorithm is based on the assumption that an interaction between the intervention and the control groups can be modeled as a fixed effect. A linear mixed model (LMM)  will be used to evaluate whether the intervention had an effect at any time point or whether the intervention influenced change (growth, trajectory) in the outcome over the course of the study. The following will be considered for the analytical strategy:
Repeated-measures ANOVA and multivariate analysis of covariance (MANCOVA) will be used to compare the effect of the COMPASSgoal intervention versus the supported discharge group, as determined by baseline assessment. ANOVA will be used to compare the change pre- to post-intervention between the two groups. Furthermore, to analyze the main effect of the COMPASSgoal intervention over time, a two-way repeated measures parametric ANOVA and a non-parametric repeated measures Friedman ANOVA will be performed using the baseline time point, levels of TBI self-efficacy, or real-world task performance as the dependent variables. The levels of the repeated-measures factor correspond to the number of assessments: baseline/pre-intervention, post-intervention/supported discharge, and at three months post-treatment follow-up. The between-groups factor will be the intervention group versus the supported discharge group.
The MANCOVA analysis will focus on the contrast in TBI self-efficacy between the intervention and supported discharge groups while accounting for a specified covariate: level of executive impairment, as defined by FrSBe. In the case of non-normal residuals, we will use a nonparametric repeated-measures approach. In the case of missing data, an LMM, which uses a maximum likelihood estimate to correct for an unequal number of measures per subject, will be employed .
Hypothesis 2: psychosocial profile as a mediator of the responsiveness to the intervention over the time course
To explore Hypothesis 2, we will utilize a multistage analytic strategy. Because of the possibility of missing data due to non-responses, missed visits, attrition, and mortality over the course of the study, the statistical analysis presents certain challenges. At the first stage, an LMM will be used to incorporate all available data, to evaluate trends, and to estimate changes in outcome variables without discarding cases that have missing data points. Furthermore, an LMM controls for confounding effects of other repeatedly measured covariates while accounting for the correlations among repeatedly measured outcomes . SAS PROC MIXED  will be used to estimate an LMM for each outcome of interest. For categorical outcomes, generalized estimating equations (GEEs) will be used to evaluate trends over time while accounting for the dependency among the repeatedly measured outcomes. GEEs will be solved using SAS PROC GENMOD .
○ An LMM will be used to control for the confounding effects of other repeatedly measured covariates while accounting for the dependency among the repeatedly measured outcomes and covariance matrix.
○ We will construct a model that includes only the repeated-measures variables to obtain the means, variances, and covariances.
○ We will add time-invariant variables such as the treatment group into the multi-level model (MEME) to predict the change over time in executive dysfunction and associated real-life task performance. This method will allow us to address individual growth, to identify latent trajectories of growth, to relate the observed changes to pre-existing differences between study participants, and to determine treatment effects.
Subsequently, we will use linear growth curves to assess individual differences and group differences following a two-stage linear growth model. At the second stage, we will construct a model that includes only the repeated-measures variables to obtain means, variances, and covariances. At stage three, we will add time-invariant variables such as age, gender, and education into the model to predict change over time in executive function and real- world performance. We will also be able to refine our model at any level by assessing the fit after additional variables are inserted. The covariance structure obtained will allow us to draw inferences with regards to linear increases or decreases in executive dysfunction and real-world performance over time. This method will allow us to address individual growth, to identify latent trajectories of growth, and finally, to relate the observed changes to pre-existing differences between study participants.
We will use an LMM to control for potential confounding variables, and baseline values will be utilized as a covariate. These models will allow for the additional control of potential variance within subject clusters from variables, such as intervention modality. These clusters, which are not part of the formal hypothesis testing but are byproducts of these models, will allow for the conceptualization of additional future hypotheses.
Analysis population and missing data
Rigorous methods to address loss to follow-up and missing data are important. As in many studies with vulnerable populations, participant dropout or censoring may be informative. For example, sicker patients and those with sub-optimal treatment results may opt to discontinue participating or providing samples or questionnaire responses. Thus, the probability of missing outcome data may be dependent on covariate data and, hence, may be “non-ignorable.”  To assess the probable types of missing data, baseline covariates among patients with and without missing data will be compared. If missing data are judged as missing completely at random, the typical strategy will be to conduct a complete case analysis, recognizing a loss of precision. The exception to this strategy will be when considerable data (i.e., >15 %) are missing on a particular covariate that is judged to be critical for inclusion in the analysis. In this instance, imputation by unconditional or conditional mean imputation will be used; these simple approaches perform well when the overall percentage of missing data is low. In rare instances when the percentage of missing data is not low (i.e., >15 %), more sophisticated multiple imputation methods may be employed. Imputation methods will not be used to fill in values for missing outcome data.
A data monitoring committee has not been established because the study has been rated a minimal risk study by the local IRB.
No interim analysis of the primary endpoint will be performed because this is a minimal risk study. All members of the study team have access to de-identified data while the trial is ongoing; however, masking is preserved for the data collector and statistician. The principal investigator and sponsor have the ultimate authority to stop or modify the trial.
For purposes of this study, adverse events are defined as any “untoward medical occurrence” temporally associated with the intervention, regardless of causality . Adverse events are routinely monitored and tracked by the study staff. Any adverse event that meets the criteria for a serious adverse event, including death, hospitalization, or any event that jeopardizes the safety of the subject, will be reported to the IRB within 5 business days of the study team’s notification of the event. Monitoring for adverse events begins when the informed consent is signed and continues until 30 days after the participant completes the study or withdraws.
The research compliance officer at the DC VAMC runs quarterly audits on informed consent and Health Insurance Portability and Accountability Act (HIPAA) documents. At each time point, a study coordinator supplies the compliance officer with a list of participants who consented and re-consented to the study during the previous quarter. The compliance officer schedules a time to examine the consent forms and HIPAA authorizations for completeness, and a report is issued. Every three years, the research compliance officer also completes a review of the study records to ensure ethics and scientific approvals are maintained appropriately.
Ethics and dissemination
Research ethics approval
The protocol, recruitment procedures, consent forms, and HIPAA authorizations were reviewed and approved by the DC VAMC IRB and Research & Development Committees prior to recruitment initiation. The PI provides annual progress reports to the IRB for continuing reviews annually.
Any significant modifications to the study protocol, such as changes to the study population, design, or implementation procedures, will be submitted to the IRB for approval prior to implementation.
Consent or assent
Once a potential subject is identified in the DC VAMC TBI database or through the TBI clinical team, a COMPASSgoal team member, researcher or clinician, as is appropriate to each veteran’s circumstances, approaches the veteran and/or family members about the study. Special care is taken to explain the nature of the study and all risks/benefits to the individual in language that is appropriate for his/her comprehension level. In addition, study investigators take special precautions to ensure that potential study participants fully understand the consent form and authorization for the release of protected health information (e.g., by reviewing the consent form and answering any questions the individual may have).
Data will not be stored in a data repository for use in ancillary studies.
Once written consent has been obtained, subjects are assigned a de-identified study number for data collection purposes by the PI. All collected data are stored in a secure, locked cabinet in a locked room at the DC VAMC and in a password-protected database. Consent forms/HIPAA authorizations are stored separately from the research record to maintain confidentiality. All crosswalk documents with personal health information to the de-identified research record are kept in a locked cabinet separate from the research record. Any discussion of identifiable patient data is sent via encrypted email. Protected health information, as defined by HIPAA, will never be used for any purpose other than the research activities of this study.
Declaration of interests
The study team has no competing interests or conflicts of interest to report.
Access to data
Only IRB-approved members of the study team will have access to the data collected in this study. If members of the research team leave the team, they will no longer have access to the data.
Ancillary and post-trial care
The DC VAMC will provide necessary medical treatment if participants are injured as a result of their participation in this study, unless they were injured because they did not follow the instructions they were given. Eligibility for other VA services will not be affected by participation in this trial. Following completion of COMPASSgoal, participants may continue to engage in medical care but will not continue to receive the COMPASSgoal intervention or support from the study team.
No publication restrictions are in place for this trial.
Publications resultant from the COMPASSgoal study will comply with the International Committee of Medical Journal Editors .
The study protocol will be disseminated to the general public through this publication.
At this writing, COMPASSgoal has begun testing and has enrolled 20 % of its target. The study COMPASSgoal Manual has been developed via the qualitative Phase I and is now implemented consistently during treatment sessions. See Fig. 3 to review the study execution algorithm.
The recruitment of participants from the mTBI population proved to be challenging initially; however, lessons learned from the early phases of recruitment strengthened and refined the study team’s approach. Originally, potential participants were required to have been discharged from interdisciplinary skilled therapies, which limited recruitment because many potential participants either re-engaged with therapy—and thereby were excluded—or ceased coming to the VA for appointments altogether upon discharge, making it difficult to recruit participants face-to-face, in accordance with VA IRB policies.
Following the identification of this problem, “discharge” from interdisciplinary treatment was more clearly defined as not being currently under review at weekly polytrauma team meetings for TBI-related skilled therapy management. Recruitment opportunities increased substantially and were subsequently further enhanced by IRB-approved flyers and letters.
This project may be regarded as a first-stage project in which the efficacy of the method is demonstrated, and the efficiency of each component is tested. The next phase, which will follow this study, would involve the development of several projects aimed at exploring the mechanisms underlying the successful vs. non-successful adaptation of veterans to everyday life and routes for transferring the ongoing delivery of intervention to the daily routine of community-dwelling veterans with TBI.
The study will prepare the field of creating supportive care environments for necessary future studies on the utilization of best clinical practice guidelines for the everyday life of veterans and their families. Clinical and applied research will concentrate on the utility of goal self-management interventions in routine care in both home and institutional settings, such as VA hospitals and community centers. These studies will also examine the cost benefits of this approach, which are expected to be substantial because the approach will lessen the time health service providers (e.g., TBI case managers or TBI social workers) must devote to their clients. In the basic research venue, studies need to explore the links between neuroanatomical structure, executive function, and everyday problem-solving in the context of psychosocial interventional research. This research would not only help improve the quality of life for veterans with TBI and other neurological deficits but also have important social benefits, such as training relatives and immediate caregivers on how to engage their loved ones in meaningful, healthy, and productive activities. The methodology proposed could be utilized with technology-based and other non-pharmacological interventions to better understand the needs and preferences of different clinical populations with chronic illnesses, or physical, cognitive, and behavioral disabilities (i.e., persons with PTSD, substance abuse, disturbing behaviors, and suicidal ideation). This particular extension may elucidate the commonalities and differences among various clinical groups and provide additional tools to improve the individual care of returning veterans.
analysis of variance
Brief Inventory of Psychosocial Functioning
Brief Symptom Inventory-18
common data elements
central nervous system
- COMPASSgoal :
Community Participation through Self-Efficacy Skills Development
Controlled Oral World Association Test
Community Reintegration of Service Members
- DC VAMC:
Washington DC VA Medical Center
Executive Function Performance Test
executive functional system
Frontal Systems Behavior Scale
generalized estimating equation
International Classification of Functioning, Disability, and Health
Health Insurance Portability and Accountability Act
Institutional Review Board
Libin Verbal-Pictorial Association Standardized Personality Test
linear mixed model
Mayo-Portland Adaptability Inventory – 4, Participation Index
multivariate analysis of covariance
M.I.N.I. International Neuropsychiatric Interview
mild traumatic brain injury
Power Analysis and Sample Size Software
Posttraumatic Stress Disorder Checklist for DSM-V
post-traumatic stress disorder
research and development
randomized controlled trial
Satisfaction with Life Scale
traumatic brain injury
Trail Making Test
Department of Veterans Affairs
Veterans Health Administration
VA Informatics and Computing Infrastructure
This work was supported by Merit Review Award # I 01 RX000637-01-A3 from the United States (U.S.) Department of Veterans Affairs Rehabilitation Research and Development Service. The contents do not necessarily represent the views of the U.S. Department of Veterans Affairs or the United States Government. Statistical support for this project was provided through the MedStar Health Research Institute, a component of the Georgetown-Howard Universities Center for Clinical and Translational Science (GHUCCTS), and supported in part with Federal funds (UL1TR000101 previously UL1RR031975) from the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through the Clinical and Translational Science Awards Program (CTSA), a trademark of DHHS, part of the Roadmap Initiative, “Re-Engineering the Clinical Research Enterprise”. Tessa Hart, PhD, consulted on self-regulation theory and goal-setting best practices after TBI and led the design of the COMPASS manual. Kelly McCarron, PsyD, and Sheree Gordon, MSN, have provided written permission for the use of their personal communication with the research team.
This work is supported by Merit Review Award # I 01 RX000637-01A3 from the United States Department of Veterans Affairs Rehabilitation Research and Development Service Program. Partial logistical support for the preparatory phase of the project was provided through the MedStar Health Research Institute, a component of the Georgetown-Howard Universities Center for Clinical and Translational Science, and supported by Grant U54 RR026076-01 from the National Center for Research Resources, a component of the National Institutes of Health. The contents of this manuscript are solely the responsibility of the authors and do not necessarily represent the views of the United States Government, the Department of Veterans Affairs, the National Center for Research Resources, the National Institutes of Health, or MedStar Health.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Arlington: American Psychiatric Publishing; 2013.Google Scholar
- Nelson LA, Yoash-Gantz RE, Pickett TC, Campbell TA. Relationship between processing speed and executive functioning performance among OEF/OIF veterans: implications for postdeployment rehabilitation. J Head Trauma Rehabil. 2009;24(1):32–40. doi:10.1097/HTR.0b013e3181957016.View ArticlePubMedGoogle Scholar
- Busch RM, McBride A, Curtiss G, Vanderploeg RD. The components of executive functioning in traumatic brain injury. J Clin Exp Neuropsychol. 2005;27(8):1022–32. doi:10.1080/13803390490919263.View ArticlePubMedGoogle Scholar
- Hart T, Djikers M, Whyte J, Braden C, Trott CT, Fraser R. Vocational interventions and supports following job placement for persons with traumatic brain injury. J Voc Rehabil. 2010;32(3):135–50. doi:10.3233/JVR-2010-0505.Google Scholar
- Hanks RA, Rapport LJ, Millis SR, Deshpande SA. Measures of executive functioning as predictors of functional ability and social integration in a rehabilitation sample. Arch Phys Med Rehabil. 1999;80(9):1030–7.View ArticlePubMedGoogle Scholar
- Anderson V, Jacobs R, Anderson PJ. Executive functions and the frontal lobes: a lifespan perspective. Studies on neuropsychology, neurology, and cognition. Hove: Psychology Press, Taylor and Francis Group; 2008.Google Scholar
- Grafman J. Executive functions. In: Parasuraman R, Rizzo M, editors. Neuroergonomics: the brain at work. New York: Oxford University Press; 2007.Google Scholar
- Draper K, Ponsford J. Cognitive functioning ten years following traumatic brain injury and rehabilitation. Neuropsychology. 2008;22(5):618–25. doi:10.1037/0894-422.214.171.1248.View ArticlePubMedGoogle Scholar
- Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems and barriers to care. US Army Med Dep J. 2008:7–17
- Zeitzer MB, Brooks JM. In the line of fire: traumatic brain injury among Iraq War veterans. AAOHN J. 2008;56(8):347–53.View ArticlePubMedGoogle Scholar
- Department of Veterans Affairs. VHA handbook 1172.04. Physical medicine and rehabilitation individualized rehabilitation and community reintegration care plan. Washington: Veterans Health Administration; 2010.Google Scholar
- Institute of Medicine (IOM). Returning home from Iraq and Afghanistan: readjustment needs of Veterans, Service Members, and their families. Washington: National Academy of Sciences; 2013.Google Scholar
- Individuals with disabilities education improvement act of 2004. 34 Code of Federal Regulations §300.7(c)(12). Washington: Government Printing Office (US); 2004.Google Scholar
- Institute of Medicine (IOM). Returning home from Iraq and Afghanistan: preliminary assessment of readjustment needs of Veterans, Service Members, and their families. Washington: National Academies Press; 2010.Google Scholar
- Sayer NA, Rettmann NA, Carlson KF, Bernardy N, Sigford BJ, Hamblen JL, et al. Veterans with history of mild traumatic brain injury and posttraumatic stress disorder: challenges from provider perspective. J Rehabil Res Dev. 2009;46(6):703–16.View ArticlePubMedGoogle Scholar
- Department of Defense. Defenselink casualty update. 2010. http://www.defenselink.mil/news/casualty.pdf. Accessed May 10 2011.
- Leland A, Oboroceanu M-J. American war and military operations casulaties: lists and statistics. Congressional Research Service, Washington, DC. 2009. http://www.fas.org/sgp/crs/natsec/RL32492.pdf. Accessed May 10 2011.
- RAND Center for Military Health Policy Research. Invisible wounds of war project. 2015. http://www.rand.org/multi/military/veterans.html. Accessed Aug 4 2015.
- Arzaga D, Shaw V, Vasile AT. Dual diagnoses: the person with a spinal cord injury and a concomitant brain injury. SCI Nurs. 2003;20(2):86–92.PubMedGoogle Scholar
- Baum CM, Connor LT, Morrison T, Hahn M, Dromerick AW, Edwards DF. Reliability, validity, and clinical utility of the Executive Function Performance Test: a measure of executive function in a sample of people with stroke. Am J Occup Ther. 2008;62(4):446–55.View ArticlePubMedGoogle Scholar
- Plotnik M, Giladi N, Hausdorff JM. Bilateral coordination of gait and Parkinson’s disease: the effects of dual tasking. J Neurol Neurosurg Psychiatry. 2009;80(3):347–50. doi:10.1136/jnnp.2008.157362.View ArticlePubMedGoogle Scholar
- Rabbitt P, editor. Methodology of frontal and executive function. Hove: Psychology Press; 1998.Google Scholar
- Luria A. Higher cortical functions in man. New York: Basic Books, Inc.; 1996.Google Scholar
- Burgess PW, Shallice T. Response suppression, initiation and strategy use following frontal lobe lesions. Neuropsychologia. 1996;34(4):263–72.View ArticlePubMedGoogle Scholar
- Bernstein NA. The co-ordination and regulation of movements. Oxford: Pergamon Press; 1967.Google Scholar
- Goldberg E. The executive brain: Frontal lobes and the civilized mind. New York: Oxford University Press; 2001.Google Scholar
- Lezak MD. Executive Functions and Motor Performance. In: Lezak MD, Howieson DB, Loring DW, Hannay JH, Fischer JS, editors. Neuropsychological Assessment. 4th ed. New York: Oxford University Press; 2004.Google Scholar
- Libin A. Mental hierarchy principles: Bridging universal and unique in mind-body research. Psychol J Russian Acad Sciences. 2008;29:10–35.Google Scholar
- Libin A. Differential psychology: On the crossroads of American, European, and Russian traditions. 5th ed. Moscow: Eksmo Education; 2008.Google Scholar
- Baddeley A. Working Memory, Thought, and Action Oxford Psychology Series. New York: Oxford University Press; 2007.View ArticleGoogle Scholar
- Niogi SN, Mukherjee P, McCandliss BD. Diffusion tensor imaging segmentation of white matter structures using a Reproducible Objective Quantification Scheme (ROQS). Neuroimage. 2007;35(1):166–74. doi:10.1016/j.neuroimage.2006.10.040.View ArticlePubMedPubMed CentralGoogle Scholar
- Laine M, Tuokkola T, Hiltunen J, Vorobyev V, Bliss I, Baddeley A, et al. Central executive function in mild cognitive impairment: a PET activation study. Scand J Psychol. 2009;50(1):33–40. doi:10.1111/j.1467-9450.2008.00682.x.View ArticlePubMedGoogle Scholar
- Heitger M, Anderson T, Jones R. A role for instrumented motor assessment in clinical assessment and outcome prediction after mild head injury. 2005. 6th World Congress on Brain Injury.Google Scholar
- Ziv I, Avraham M, Dabby R, Zoldan J, Djaldetti R, Melamed E. Early-occurrence of manual motor blocks in Parkinson’s disease: a quantitative assessment. Acta Neurol Scand. 1999;99(2):106–11.View ArticlePubMedGoogle Scholar
- Lezak MD. The problem of assessing executive functions. Int J Psychology. 1982;17:281–97.View ArticleGoogle Scholar
- Scott SH. Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci. 2004;5(7):532–46. doi:10.1038/nrn1427.View ArticlePubMedGoogle Scholar
- Stuss DT. Biological and psychological development of executive functions. Brain Cogn. 1992;20(1):8–23.View ArticlePubMedGoogle Scholar
- Gibb WR. Neuropathology of Parkinson’s disease and related syndromes. Neurol Clin. 1992;10(2):361–76.PubMedGoogle Scholar
- Koechlin E, Corrado G, Pietrini P, Grafman J. Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning. Proc Natl Acad Sci U S A. 2000;97(13):7651–6. doi:10.1073/pnas.130177397.View ArticlePubMedPubMed CentralGoogle Scholar
- Baddley AD, Hitch GJ. Working memory. In: Bower G, editor. The psychology of learning and motivation. New York: Academic; 1974. p. 47–90.Google Scholar
- Goldberg E. editor. Contemporary neuropsychology and the legacy of Luria. Institute for research in behavioral neuroscience studies. Hove: Psychology Press; 1990.Google Scholar
- Christensen A-L. Luria’s neuropsychological investigation. 2nd ed. Denmark: Munksgaard; 1984.Google Scholar
- Jason GW. Manual sequence learning after focal cortical lesions. Neuropsychologia. 1985;23(4):483–96.View ArticlePubMedGoogle Scholar
- Harrington DL, Haaland KY. Hemispheric specialization for motor sequencing: abnormalities in levels of programming. Neuropsychologia. 1991;29(2):147–63.View ArticlePubMedGoogle Scholar
- Raskin SA, Borod JC, Tweedy JR. Set-shifting and spatial orientation in patients with Parkinson’s disease. J Clin Exp Neuropsychol. 1992;14(5):801–21. doi:10.1080/01688639208402864.View ArticlePubMedGoogle Scholar
- Grafman J, Holyoak KJ, Boller F, editors. Structure and functions of the human prefrontal cortex. New York: New York Academy of Sciences; 1995.Google Scholar
- Grafman J, Levin HS, editors. Cerebral reorganization of function after brain damage. New York: Oxford University Press; 2000.Google Scholar
- Riederer P, Wuketich S. Time course of nigrostriatal degeneration in parkinson’s disease. A detailed study of influential factors in human brain amine analysis. J Neural Transm. 1976;38(3–4):277–301.View ArticlePubMedGoogle Scholar
- Fisher AG. The assessment of IADL motor skills: an application of many-faceted Rasch analysis. Am J Occup Ther. 1993;47(4):319–29.View ArticlePubMedGoogle Scholar
- Cicerone KD. Rehabilitation of executive function impairments. In: High WH, Sander AM, Struchen MA, Hart KA, editors. Rehabilitation for traumatic brain injury. New York: Oxford University Press; 2005. p. 71–87.Google Scholar
- Levine B, Robertson IH, Clare L, Carter G, Hong J, Wilson BA, et al. Rehabilitation of executive functioning: an experimental-clinical validation of goal management training. J Int Neuropsychol Soc. 2000;6(3):299–312.View ArticlePubMedGoogle Scholar
- Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004;351(1):13–22. doi:10.1056/NEJMoa040603.View ArticlePubMedGoogle Scholar
- Carlson KF, Kehle SM, Meis LA, Greer N, Macdonald R, Rutks I, et al. Prevalence, assessment, and treatment of mild traumatic brain injury and posttraumatic stress disorder: a systematic review of the evidence. J Head Trauma Rehabil. 2011;26(2):103–15. doi:10.1097/HTR.0b013e3181e50ef1.View ArticlePubMedGoogle Scholar
- Scott SG, Scholten JD, Latlief GA, Humayun F, Belanger HG, Vanderploeg RD. Polytrauma rehabilitation. In: Frontera WR, Silver JK, Rizzo TD, editors. Essentials in physical medicine and rehabilitation. Second Editionth ed. Philadelphia: Saunders; 2008.Google Scholar
- Belanger HG, Uomoto JM, Vanderploeg RD. The Veterans Health Administration’s (VHA’s) Polytrauma System of Care for mild traumatic brain injury: costs, benefits, and controversies. J Head Trauma Rehabil. 2009;24(1):4–13. doi:10.1097/HTR.0b013e3181957032.View ArticlePubMedGoogle Scholar
- Shames J, Treger I, Ring H, Giaquinto S. Return to work following traumatic brain injury: trends and challenges. Disabil Rehabil. 2007;29(17):1387–95. doi:10.1080/09638280701315011.View ArticlePubMedGoogle Scholar
- Sayer NA, Noorbaloochi S, Frazier P, Carlson K, Gravely A, Murdoch M. Reintegration problems and treatment interests among Iraq and Afghanistan combat veterans receiving VA medical care. Psychiatr Serv. 2010;61(6):589–97.View ArticlePubMedGoogle Scholar
- Carlson KF, Sayer NA, Gravely AA, Noorbaloochi S, editors. Potential risk factors for post-deployment injury among combat veterans. Society for Epidemiologic Research Annual Research. 2009 Anaheim, CA.
- Penk W, Drebing CE, Rosenheck RA, Krebs C, Van Ormer A, Mueller L. Veterans Health Administration Transitional work experience vs. job placement in veterans with co-morbid substance use and non-psychotic psychiatric disorders. Psychiatr Rehabil J. 2010;33(4):297–307. doi:10.2975/33.4.2010.297.307.View ArticlePubMedGoogle Scholar
- World Health Organization (WHO). International classification of functioning, disability, and health. Geneva: World Health Organization; 2001.Google Scholar
- Donovan JJ, Williams KJ. Missing the mark: effects of time and causal attributions on goal revision in response to goal-performance discrepancies. J Appl Psychol. 2003;88(3):379–90.View ArticlePubMedGoogle Scholar
- Meyers A, Whelan J, Murphy S. Cognitive behavioral strategies in athletic performance enhancement. In: Hersen RM, Eisler RM, Miller PM, editors. Progress in behavior modification. New York: Academic; 1996. p. 137–64.Google Scholar
- Oettingen G, Pak H, Schnetter K. Self-regulation of goal setting: turning free fantasies about the future into binding goals. J Pers Soc Psychol. 2001;80(5):736–53.View ArticlePubMedGoogle Scholar
- Department of Veterans Affairs. VHA handbook 1172.01: Polytrauma system of care. Washington: Veterans Health Administration; 2013.Google Scholar
- Malec JF. The Mayo-Portland Participation Index: A brief and psychometrically sound measure of brain injury outcome. Arch Phys Med Rehabil. 2004;85(12):1989–96.View ArticlePubMedGoogle Scholar
- Wei LJ, Lachin JM. Properties of the urn randomization in clinical trials. Control Clin Trials. 1988;9(4):345–64. Erratum in: Controlled Clin Trials 1989 Mar;10(1): following 126.View ArticlePubMedGoogle Scholar
- Government Accountability Office. VA Health Care Mild traumatic brain injury screening and evaluation implemented for OEF/OIF Veterans, but challenges remain. Washington: Government Accountability Office; 2008.Google Scholar
- Grace J, Malloy PF. FrSBe: Frontal Systems Behavior Scale professional manual. Lutz: Psychological Assessment Resources, Inc.; 2001.Google Scholar
- Amorim P, Lecrubier Y, Weiller E, Hergueta T, Sheehan D. DSM-III-R Psychotic Disorders: Procedural validity of the M.I.N.I. International Neuropsychiatric Interview (M.I.N.I.) Concordance and causes for discordance with the CIDI. Eur Psychiatry. 1998;13:26–34.View ArticlePubMedGoogle Scholar
- Lecrubier Y, Sheehan D, Weiller E, Amorim P, Bonora I, Sheehan K, et al. The M.I.N.I. International Neuropsychiatric Interview (M.I.N.I.) A short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997;12:224–31.View ArticleGoogle Scholar
- Sheehan DV, Lecrubier Y, Harnett-Sheehan K, Amorim P, Janavs J, Weiller E, et al. The M.I.N.I. International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview. J Clin Psychiatry. 1998;59 suppl 20:22–33.PubMedGoogle Scholar
- Sheehan DV, Lecrubier Y, Harnett-Sheehan K, Janavs J, Weiller E, Bonara LI, et al. Reliability and validity of the M.I.N.I. Neuropsychiatric Interview (M.I.N.I.): according to the SCID-P. Eur Psychiatry. 1997;12:232–41.View ArticleGoogle Scholar
- Simon GE, Ludman EJ, Tutty S, Operskalski B, Von Korff M. Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment: a randomized controlled trial. JAMA. 2004;292(8):935–42. doi:10.1001/jama.292.8.935.View ArticlePubMedGoogle Scholar
- Mohr DC, Ho J, Duffecy J, Reifler D, Sokol L, Burns MN, et al. Effect of telephone-administered vs face-to-face cognitive behavioral therapy on adherence to therapy and depression outcomes among primary care patients: a randomized trial. JAMA. 2012;307(21):2278–85. doi:10.1001/jama.2012.5588.View ArticlePubMedPubMed CentralGoogle Scholar
- Hoerster KD, Jakupcak M, Stephenson KR, Fickel JJ, Simons CE, Hedeen A, et al. A pilot trial of telephone-based collaborative care management for PTSD among Iraq/Afghanistan war veterans. Telemed J E Health. 2015;21(1):42–7. doi:10.1089/tmj.2013.0337.View ArticlePubMedPubMed CentralGoogle Scholar
- Bradbury CL, Christensen BK, Lau MA, Ruttan LA, Arundine AL, Green RE. The efficacy of cognitive behavior therapy in the treatment of emotional distress after acquired brain injury. Arch Phys Med Rehabil. 2008;89(12 Suppl):S61–8. doi:10.1016/j.apmr.2008.08.210.View ArticlePubMedGoogle Scholar
- Elnitsky CA, Andresen EM, Clark ME, McGarity S, Hall CG, Kerns RD. Access to the US Department of Veterans Affairs health system: self-reported barriers to care among returnees of Operations Enduring Freedom and Iraqi Freedom. BMC Health Serv Res. 2013;13:498. doi:10.1186/1472-6963-13-498.View ArticlePubMedPubMed CentralGoogle Scholar
- Stout JC, Ready RE, Grace J, Malloy PF, Paulsen JS. Factor analysis of the frontal systems behavior scale (FrSBe). Assessment. 2003;10(1):79–85.View ArticlePubMedGoogle Scholar
- Reid-Arndt SA, Nehl C, Hinkebein J. The Frontal Systems Behaviour Scale (FrSBe) as a predictor of community integration following a traumatic brain injury. Brain Inj. 2007;21(13–14):1361–9. doi:10.1080/02699050701785062.View ArticlePubMedGoogle Scholar
- Reitan RM. Validity of the trail making test as an indicator of organic brain damage. Percept Mot Skills. 1958;8(3):271–6.View ArticleGoogle Scholar
- Fals-Steward W. An interrater reliability study of the trail making test (parts A and B). Percept Mot Skills. 1992;74(1):39–42.View ArticleGoogle Scholar
- Benton A, Hansher K. Multilingual Aphasia Examination. Iowa City: AJA Associates; 1989.Google Scholar
- Ross TP. The reliability of cluster and switch scores for the Controlled Oral Word Association Test. Arch Clin Neuropsychol. 2003;18(2):153–64.View ArticlePubMedGoogle Scholar
- Dickstein BD, Weathers FW, Angkaw AC, Nievergelt CM, Yurgil K, Nash WP, et al. Diagnostic utility of the Posttraumatic Stress Disorder (PTSD) Checklist for identifying full and partial PTSD in active-duty military. Assessment. 2015;22(3):289–97.View ArticlePubMedGoogle Scholar
- Baum CM, Wold TJ. Executive Functioning Performance Test (EFPT). St. Louis: Washington University School of Medicine; 2013.Google Scholar
- Derogatis LR. Brief Symptom Inventory (BSI)-18: administration, scoring, and procedures manual. Minneapolis: NCS Pearson; 2001.Google Scholar
- Meachen SJ, Hanks RA, Millis SR, Rapport LJ. The reliability and validity of the brief symptom inventory-18 in persons with traumatic brain injury. Arch Phys Med Rehabil. 2008;89(5):958–65.View ArticlePubMedGoogle Scholar
- Marx B. Development and validation of a PTSD-related impairment scale. U.S. Army Medical Research and Materiel Command (USAMRMC), Fort Detrick, MD. 2010. handle.dtic.mil/100.2/ADA540811. Accessed Dec 19 2013.Google Scholar
- Libin A. The geometrical form preferences test through human-figure-contructive-drawings (A manual). Moscow: Institute of Psychology at the Russian Academy of Sciences; 1994.Google Scholar
- Libin A, Libin E, Libin V. The geometrical form preferences test through human-figure-constructive-drawings. (A manual for clinicians). Moscow: Eksmo Education; 2008.Google Scholar
- Huckans M, Pavawalla S, Demadura T, Kolessar M, Seelye A, Roost N, et al. A pilot study examining effects of group-based Cognitive Strategy Training treatment on self-reported cognitive problems, psychiatric symptoms, functioning, and compensatory strategy use in OIF/OEF combat veterans with persistent mild cognitive disorder and history of traumatic brain injury. J Rehabil Res Dev. 2010;47(1):43–60.View ArticlePubMedGoogle Scholar
- Libin E. Coping intelligenceTM: integrated approach to coping with life difficulties. Moscow: Eksmo Education; 2008.Google Scholar
- Resnik L, Plow MA. Measuring participation as defined by the international classification of functioning, disability, and health: an evaluation of existing measures. Arch Phys Med Rehabil. 2009;90(5):856–66.View ArticlePubMedGoogle Scholar
- Resnik L, Plow M, Jette A. Development of CRIS: measure of community reintegration of injured service members. JRRD. 2009;46(4):469–80.View ArticleGoogle Scholar
- Resnik L, Gray M, Borgia M. Measurement of community reintegration in sample of severely wounded servicemembers. JRRD. 2011;48(2):89–102.View ArticleGoogle Scholar
- Diener E, Emmons R, Larsen J, Griffin S. The satisfcation with life scale. J Personality Assessment. 1985;49(1):71–5.View ArticleGoogle Scholar
- NCSS. Statistical Software. Kaysville: Power Analysis and Sample Size Software; 2008.Google Scholar
- IBM Corp. IMB SPSS Statistics for Windows. Version 21.0. Armonk: IBM Corp; 2012.Google Scholar
- VA Informatics and Computer Infrastructure-VINCI Central. VINCI description for IRBs. Department of Veterans Affairs. 2014. http://vaww.vinci.med.va.gov/vincicentral/overview.html. Accessed Oct 28 2014.
- Diggle PJ, Heagerty PJ, Liang K-Y, Zeger SL. Analysis of longitudinal data. 2nd ed. New York: Oxford University Press; 2002.Google Scholar
- SAS Institute Inc. SAS/STAT© 9.2 user’s guide. Cary: SAS Institute, Inc; 2008.Google Scholar
- Nich C, Carroll KM. Intention-to-treat meets missing data: Implications of alternate strategies for analyzing clinical trials data. Drug Alcohol Depend. 2002;68(2):121–30.View ArticlePubMedPubMed CentralGoogle Scholar
- International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use. Clinical Safety Data Management: Definitions and Standards for Expedited Reporting E2A. ICH; 1994.
- International Committee of Medical Journal Editors. Uniform requirements for manuscripts submitted to biomedical journals: Writing and editing for biomedical publications. 2010.Google Scholar
- Hoge CW, McGurk D, Thomas JL, Cox AL, Engel CC, Castro CA. Mild traumatic brain injury in U.S. Soldiers returning from Iraq. N Engl J Med. 2008;358(5):456–63.View ArticleGoogle Scholar