-
Notifications
You must be signed in to change notification settings - Fork 3
/
23-Behavioral-Assessment.Rmd
280 lines (219 loc) · 32.9 KB
/
23-Behavioral-Assessment.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
# Behavioral Assessment {#behavioral}
## Overview of Behavioral Assessment {#overview-behavioral}
In other chapters, we discuss using [psychophysiological assessment](#psychophysiological), [cognitive assessment](#cognition), and other assessment techniques.
Psychology is often concerned about understanding behavior.
To assess behavior, one approach would be to observe people.\index{observation}
Observing people allows seeing the dynamic of the behavior unfold in relation to other processes.\index{observation}
Observations might also allow getting around examinees' [response biases](#methodBias) such as social desirability.\index{observation}\index{bias!social desirability}
Behavioral observation provides a temporal stream of behavior to see which behaviors precede other behaviors.\index{observation}
An overview of observational assessment is provided by @Girard2016.\index{observation}
When conducting observations, it is important to consider the context and the environment.\index{observation}
### Approaches {#observationApproaches}
Examples of behavioral assessment include naturalistic behavioral observation, analogue (structured) observation, self-monitoring/diary, behavior ratings (e.g., informant report), and self-report.\index{observation}\index{self-report}\index{informant report}\index{observation!naturalistic}\index{observation!analogue}
Self-report is essentially retrospective self-monitoring.\index{observation}\index{self-report}
I published a practice brief for the assessment of externalizing behavior in school-aged children that integrates these different methods of behavioral assessment [@Petersen2024a].
Naturalistic behavioral observation involves observing a person in their natural context or habitat.\index{observation!naturalistic}
For instance, it might involve a person in their home, at school, at work, or their everyday interpersonal interactions.\index{observation!naturalistic}
The observer is like a "fly on the wall" in that they want to exert as little effect as possible on the person's behavior.\index{observation!naturalistic}
The observation occurs within normal situational contexts and under naturally occurring reinforcements and consequences.\index{observation!naturalistic}
Naturalistic observations were the origins of behavioral assessment.\index{observation!naturalistic}
Analogue observation, also called structured observation, is the observation of a person in a contrived environment [@Haynes2001].\index{observation!analogue}
The goal of analogue observation is for the contrived situation to be analogous to the situations that the client is likely to encounter in their natural environment.\index{observation!analogue}
For instance, the examiner might set up similar conditions in a lab or therapy room.\index{observation!analogue}
Analogue observations can differ in the degree to which the observation is structured, but they are typically more structured than naturalistic observation.\index{observation!analogue}\index{structured!administration}
Analogue observations might involve role-plays, family or marital interaction tasks, and compliance (do/don't) tasks.\index{observation!analogue}
As an example, the observer might observe role-played scenarios in which the person engages in one or more simulated social interactions.\index{observation!analogue}
## Contexts for Observing {#observationContexts}
There are multiple contexts in which we can observe people.\index{observation!contexts}
Here are just a few examples:\index{observation!contexts}
- Classrooms\index{observation!contexts}
- Homes\index{observation!contexts}
- In the community; for example, you could take a client out into the world to see how they interact with others\index{observation!contexts}
- Group homes\index{observation!contexts}
- Psychiatric hospitals\index{observation!contexts}
Token economies for people with schizophrenia were based on behavioral assessment in psychiatric hospitals.\index{observation!contexts}
A token economy is a contingency management system based on operant conditioning.\index{observation!contexts}
Operant conditioning occurs when the frequency of behavior is influenced by the outcomes of the behavior.\index{observation!contexts}
In a token economy, a secondary reinforcer, such as a token or symbol, is given to the client for matching the target behavior, which can be exchanged for back-up reinforcers.\index{observation!contexts}
For instance, a token may be given to the client for making their bed.\index{observation!contexts}
The tokens could then be turned in for back-up reinforcers.\index{observation!contexts}
Back-up reinforcers include material reinforcers such as food, money, and cigarettes; services, such as having your room cleaned; and privileges such as getting to make a phone call.\index{observation!contexts}
Token economies have been shown to work and to influence people's behavior, especially the negative symptoms of schizophrenia.\index{observation!contexts}
However, token economies are not widely used because of political issues.\index{observation!contexts}
## Costs of Behavioral Observation {#observationCosts}
Behavioral observations are costly due to people and time.\index{observation!costs}
The cost limits the amount of observation time that is possible, which raises questions about how typical and representative the participant's behavior was during the observation period relative to their everyday life.\index{observation!costs}
The limited amount of observation time raises questions about [reliability](#reliability) and [external validity](#externalValidity), that is the [generalizability](#gTheory) of the person's behavior in the situation to their typical functioning.\index{observation!costs}\index{observation!reliability}\index{observation!validity}\index{validity!external}
A gold standard for naturalistic observations would be to observe someone in their natural context across more than one day, time, situation, and context with more than one rater to get a more robust sampling of the person's behavior.\index{observation!naturalistic}\index{validity!external}
But it is costly to do this, and is therefore uncommon in practice.\index{observation!costs}
## Dependent Variable {#observationDV}
After (or during) the observation, we need to turn the observation into information that can be useful.
To do that, we create a dependent variable using behavioral coding.\index{observation!coding}
Behavioral coding involves observing behavior and quantifying it, that is turning behavior into numbers that can be analyzed to make inferences.\index{observation!coding}
During observation, you can measure the frequency of the behavior (how many times a behavior occurs), which is a useful measure of individual differences.\index{observation!coding}
But you may want to know the stream of behavior, so you know when the behavior occurred.\index{observation!coding}
So, you might make a coding sample at regular intervals (e.g., every 6 seconds).\index{observation!coding}
Coding systems can differ in their granularity with which they treat time.\index{observation!coding}
In *event-based coding*, the coder codes whenever a discrete behavior occurs—i.e., the behavior has discrete start and stop points.\index{observation!coding!event-based}
For example, an event-based coding system may determine when a person is talking.\index{observation!coding!event-based}
Event-based coding allows assessing the number, duration, and sequence of behaviors with high temporal precision.\index{observation!coding!event-based}
In *interval-based coding*, the coder codes during specified spans of time that are called intervals.\index{observation!coding!interval-based}
Intervals can be of any length.\index{observation!coding!interval-based}
Shorter intervals provide more temporal precision but are more burdensome to code.\index{observation!coding!interval-based}
Longer intervals provide less temporal precision but are less burdensome to code.\index{observation!coding!interval-based}
An example of interval-based coding would be coding the extent of positive affect that a person showed during each 10-second interval.\index{observation!coding!interval-based}
Coding can focus on the small units of behavior or what the behavior means.\index{observation!coding}
*Sign-based coding* involves focusing on small units of behavior, such as movements.\index{observation!coding!sign-based}
*Message-based coding* involves focusing on the meaning of the behavior using theory.\index{observation!coding!message-based}
For example, message-based coding might attempt to code examinees' emotional states.\index{observation!coding!message-based}
Sign-based coding requires a lesser degree of inference, has less subjectivity, and has higher [inter-rater reliability](#interrater-reliability) than message-based coding.\index{observation!coding!sign-based}\index{observation!reliability}\index{reliability!inter-rater}
On the other hand, message-based coding is potentially more theoretically interesting than sign-based coding.\index{observation!coding!message-based}\index{observation!coding!sign-based}
## Functional Behavioral Assessment/Analysis {#fba}
One goal of behavioral assessment is to determine the function of the problem behavior.\index{functional behavioral assessment}
Every behavior has a function, reason, or purpose (or multiple ones).\index{functional behavioral assessment}
If you can determine the function(s) of the behavior, you may be able to help the client learn more adaptive ways of accomplishing their goals.\index{functional behavioral assessment}
To determine the function(s) of behavior, functional behavioral assessments (FBAs) are commonly conducted, especially in schools.\index{functional behavioral assessment}
FBA involves identifying the patterns of sequences that involve the problem behavior, noting the following:\index{functional behavioral assessment}
- The time\index{functional behavioral assessment}
- The context\index{functional behavioral assessment}
- What led up to the problem behavior (antecedents)\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
- What problem behavior occurred\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
- What happened after the problem behavior (consequences)\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
- How the situation resolved\index{functional behavioral assessment}
An FBA is based on the antecedent-behavior-consequence (A-B-C) model.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
The idea of the A-B-C model is that every behavior is a function of its antecedents and consequences.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
The goal of the A-B-C model is to identify common patterns of antecedents and consequences.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
Examples of antecedents include insufficient sleep, a change in routine, and an ineffective command.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
Examples of consequences include giving attention, and getting to play without having to pick up the toys.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
By identifying the patterns of antecedents and consequences, we can generate hypotheses for the function of the behavior.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
For example, a possible hypothesis for a function of given problem behavior might be to get attention, to get out of doing what they do not want to do (escape or avoidance), to get access to a preferable activity or object, or to engage in sensory stimulation (e.g., rocking).\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
You can design treatment to change the antecedents and consequences to show them more adaptive ways of behaving.\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
One approach to case conceptualization or case formulation is the "5 Ps": protective factors, predisposing factors, precipitating factors, perpetuating factors, and prognosis.\index{case conceptualization}
Treatment would focus on addressing the perpetuating (maintaining) factors, and helping the client identify the triggering (precipitating) factors and how to handle those, while building on their strengths (protective factors) and considering their vulnerabilities (predisposing factors), with the intensity of treatment matched to the prognosis.\index{case conceptualization}
## Mental Status Exam {#mse}
A mental status exam is a structured assessment of a client's cognition, affect, etc.\index{mental status exam}
A mental status exam is often used in psychiatric hospitals to quickly "size up" a patient.\index{mental status exam}
Mental status exams are also useful in outpatient settings.
For training clinicians, it can be useful to get in the habit of performing mental status exams.\index{mental status exam}
## Reliability {#reliability-observation}
It is important to consider the [reliability](#reliability) of behavioral observations.\index{observation!reliability}
From a [generalizability](#gTheory) perspective, we aim to generalize behavioral observations across, raters, contexts, and time points.\index{observation!reliability}\index{generalizability theory}
Thus, [inter-rater reliability](#interrater-reliability) and [test–retest reliability](#testRetest-reliability) are especially relevant.\index{observation!reliability}\index{reliability!inter-rater}\index{reliability!test–retest}
Averaging ratings across multiple raters can yield scores that are more [reliable](#reliability) than the scores from the individual raters, assuming both raters have [inter-rater reliability](#interrater-reliability).\index{observation!reliability}\index{reliability!inter-rater}
## Validity {#validity-observation}
[Validity](#validity) is also an important consideration of behavioral observations.\index{observation!validity}
In general, little attention has been paid to [validity](#validity) of observational measures, particularly those used in clinical practice.\index{observation!validity}
This is a [content validity](#contentValidity) problem.\index{observation!validity}\index{validity!content}
When coding, the examiner makes choices about what to code; they are not "writing down the real thing".\index{observation!validity}\index{observation!coding}
### Reactivity {#reactivity}
Another concern of observational measures is [response biases](#methodBias), such as faking good, faking bad, and impression control.\index{observation!reactivity}\index{response style}
For instance, people may act differently because they are being observed, which is a form of *reactivity*.\index{observation!reactivity}
[Reactivity](#reactivity) is the change in a behavior for the mere reason that the behavior is being observed or measured.\index{observation!reactivity}
People could behave better or worse than they typically do—observation tends to push people to the extremes.\index{observation!reactivity}
### Coding {#coding}
Regarding coders and observers, it is ideal during training to provide them immediate corrective feedback.\index{observation!coding}
It is ideal for them to be blind to hypotheses, so they are not [biased](#bias) in favor of a particular outcome.\index{observation!coding}\index{bias}
It can be helpful to periodically compare coders' ratings to criterion ratings that are accepted as the gold-standard ratings to prevent coder drift.\index{observation!coding}
Coder drift occurs when there are changes in coders' ratings over time.\index{observation!coding}
You can evaluate [intra-observer reliability](#intrarater-reliability) by having them rate the same (video-recorded) behavior at two different time points.\index{observation!coding}\index{reliability!intra-rater}\index{observation!reliability}
You can have two or more raters code at least a subset of the participants, to establish [inter-rater reliability](#interrater-reliability).\index{observation!coding}\index{reliability!inter-rater}\index{observation!reliability}
## Forms of Measurement {#formsOfMeasurement-observation}
There are several forms of measurement that behavioral assessments can take.\index{observation!coding}
One form of measurement from observation is notes, which involves qualitative data.\index{observation!coding}\index{data!qualitative}
For rating scales, the form of measurement is often Likert scales.\index{observation!coding}\index{Likert scale}
Likert scales assess the observer's impression of the examineee's behavior, which is a simpler way of getting the same information as many approaches to video coding.\index{observation!coding}\index{Likert scale}
Rating scales can be completed in the context of, for example, a home observation, parent report, teacher report, or school observation.\index{observation!coding}\index{Likert scale}
It can be helpful to examine correlations between these different methods and contexts.\index{observation!coding}
Having multiple forms of measurement is great for research but is difficult to do in clinical practice because it comes at a tremendous expense.\index{observation!coding}
There is also difficulty in observing what you want to observe.\index{observation!coding}
For example, aggression is a relatively low [base rate](#baseRate) phenomenon, so the client may not engage in aggressive behavior during the observation window.\index{observation!coding}\index{base rate}
There are also questions of the [incremental validity](#incrementalValidity) of naturalistic observational assessments because simpler measures (including [analogue assessments](#analogueAssessment)) could get at the same thing.\index{observation!coding}\index{validity!incremental}\index{observation!validity}
## Analogue (Structured) Observational Assessments {#analogueAssessment}
Analogue or structured assessments use tasks that evoke individual differences in the behavior of interest.\index{observation!analogue}
For instance, in our lab we have forbidden toys on a shelf, and we see how the children and parents handle that situation when they are in the room together, then when the parent is occupied on the phone, and then when the parent leaves the room and the child is alone in the room.\index{observation!analogue}
In the clinic, we have a parent tell their child to clean up the toys so we can observe how the parent gives the command and how the child responds.\index{observation!analogue}
To study marital conflict, researchers may have the couple provide a list of topics they disagree about, and have them have a discussion about one of those topics to evoke an argument in the lab.\index{observation!analogue}
To study stress and anxiety, or to perform exposure in the clinic, the clinician or researcher may have the client/participant give a public speech in a simulated session.\index{observation!analogue}
The goal of analogue assessments is that the tasks should have [content validity](#contentValidity).\index{observation!analogue}\index{validity!content}\index{observation!validity}
That is, the tasks should be relevant to the target construct, and they should be representative of the tasks the person is likely to face in their natural environment by sampling all facets that affect the behavior problem in the natural environment.\index{observation!analogue}\index{validity!content}\index{observation!validity}
Analogue assessment can lead to greater frequency of target behavior through the use of contrived situations or stimuli, compared to [naturalistic observation](#observationApproaches).\index{observation!analogue}\index{observation!naturalistic}
For instance, noncompliance might occur more often when doing a compliance task in the lab than when observing a child in their natural environment.\index{observation!analogue}
Therefore, the frequency or rate of behavior may not [generalize](#gTheory) to the natural context.\index{observation!analogue}
But the functional relations of the behavior in relation to other behaviors, such as antecedents and consequences, may [generalize](#gTheory).\index{observation!analogue}\index{antecedent-behavior-consequence}
Thus, they can help identify potential intervention targets.\index{observation!analogue}
Analogue assessment is most useful for assessing behaviors that are difficult or rare to observe in the natural environment but that are frequent in the analogue environment.\index{observation!analogue}
For example, analogue assessment is particularly useful for assessing socially sensitive behavior problems such as verbal aggression, panic, and oppositional behavior.\index{observation!analogue}
Analogue assessment can be sensitive to change, and therefore can be a clinically useful measure of treatment gains or failure.\index{observation!analogue}\index{change!sensitivity to}
A client who cannot demonstrate a skill in the clinic may not be able to demonstrate a skill in the real world.\index{observation!analogue}
But just because they show a skill in a session does not necessarily mean they will be able to use it in the real world.\index{observation!analogue}
In terms of [reliability](#reliability) and [validity](#validity), analogue/structured assessments tend to show greater [reliability](#reliability) than naturalistic observations.\index{observation!analogue}\index{observation!naturalistic}\index{observation!reliability}\index{observation!validity}
Analogue assessments tend to show greater [internal validity](#internalValidity) than naturalistic observations.\index{observation!analogue}\index{observation!naturalistic}\index{observation!validity}\index{validity!internal}
That is, analogue assessments are more likely to reflect causal factors because they have more control of when and how the stimuli are presented.\index{observation!analogue}\index{observation!naturalistic}\index{observation!validity}\index{validity!internal}
However, analogue assessments show weaker [ecological validity](#ecologicalValidity) than naturalistic observations and therefore tend to show weaker [external validity](#externalValidity).\index{observation!analogue}\index{observation!naturalistic}\index{observation!validity}\index{validity!ecological}\index{validity!external}
That is, analogue assessments yield lower [generalizability](#gTheory) than naturalistic observations because analogue assessments may not be as reflective of their functioning in the real world.\index{observation!analogue}\index{observation!naturalistic}\index{observation!validity}\index{validity!ecological}\index{validity!external}
Nevertheless, analogue assessments tend to show greater clinical utility, in terms of [incremental validity](#incrementalValidity) and cost-effectiveness than naturalistic observations, when they are done well.\index{observation!analogue}\index{observation!naturalistic}\index{observation!validity}\index{validity!incremental}
## Self-Monitoring {#selfMonitoring}
Self-monitoring involves observing and recording one's own behaviors, thoughts, emotions, bodily sensations, events, etc.\index{self-monitoring}
Given the expense of conducting behavioral observations, you can train people to be their own observers, which has better portability.\index{self-monitoring}
Phone apps can now be used to track many different processes, such as mood, sleep, and nutrition.\index{self-monitoring}
These are examples of electronic diaries.\index{self-monitoring}
An overview of research on self-monitoring and electronic diaries is provided by @Korotitsch1999 and @Piasecki2007.\index{self-monitoring}
Self-monitoring provides a great deal of information at a low cost.\index{self-monitoring}
There are several benefits of self-monitoring.\index{self-monitoring}
Self-monitoring can help characterize the problem and the presumed causal or maintaining factors.\index{self-monitoring}
Self-monitoring can also contribute to greater objective self-awareness.\index{self-monitoring}
In addition, self-monitoring can be used to track treatment progress.\index{self-monitoring}
Furthermore, self-monitoring can be helpful for assessing covert behaviors that are hidden to outside observers, such as obsessions, paranoid thoughts, and sexual problems.\index{self-monitoring}
Self-monitoring is a component of most empirically supported treatments.\index{self-monitoring}\index{empirically supported treatment}
In addition, the extent to which clients complete self-monitoring is predictive of treatment effectiveness.\index{self-monitoring}
As an example of self-monitoring in therapy, in parent management training, we have parents track (tally) the frequency of their child's compliance, noncompliance, and aggression each day during the week between sessions as homework.\index{self-monitoring}
Self-monitoring provides a more objective way to track treatment progress than retrospective reports or satisfaction ratings because clients track the specific behavior the moment it occurs.\index{self-monitoring}
We modify treatment in response to the information gained from tracking.\index{self-monitoring}
We also become more aware of the situations and contexts in which the behavior occurs, so it is predictable and the client can better anticipate, prepare for, and control the problem.\index{self-monitoring}
Based on principles of measurement-based care, assessment does not just occur at the outset of treatment; it should continue throughout treatment.\index{self-monitoring}\index{measurement-based care}
And self-monitoring helps parents become more aware of the actual frequency of the problem behavior.\index{self-monitoring}
For instance, they might have over- (or under-)estimated how often a behavior occurs.\index{self-monitoring}
Thus, self-monitoring can lead to a change in people's perceptions of the behavior.\index{self-monitoring}
Also, some children will misbehave less at home or school due to [reactivity](#reactivity) because they know they are being observed, so this can be a way of kick-starting some behavioral improvement.\index{self-monitoring}\index{observation!reactivity}
There are often changes in a behavior in response to self-monitoring—typically, the client experiences behavioral improvement.\index{self-monitoring}\index{observation!reactivity}
Self-monitoring might increase awareness of how often a problem behavior is happening and their perceived predictability and control of the behavior.\index{self-monitoring}
Self-monitoring is now considered an empirically supported treatment for a number of conditions, including academic/conduct problems, addictive behaviors, anxiety and depression, disordered eating, physical health problems, psychosis, and insomnia.\index{self-monitoring}\index{empirically supported treatment}
That is, assessment is a form of intervention!\index{self-monitoring}\index{assessment!as an intervention}
However, there are challenges to self-monitoring.\index{self-monitoring}
One challenge is how to evaluate the [reliability](#reliability) of self-monitoring.\index{self-monitoring}\index{self-monitoring!reliability}
Another challenge is how to handle if the client fills out the whole tracking sheet retrospectively, all at once, right before session—this is called "backfilling".\index{self-monitoring}
In addition, there is a possibility of inaccuracy and distortion with self-monitoring due to the respondent not having been trained on how to observe the phenomenon of interest.\index{self-monitoring}
To counter this, in parent management training, we explicitly define what counts as an instance of compliance, noncompliance, and aggression.\index{self-monitoring}
Another challenge with self-monitoring is that it involves respondent burden because it requires compliance by the client.\index{self-monitoring}
To handle noncompliance with self-monitoring, it can be helpful to "get procedural" and to discuss with the client when they will track, where they will put the tracking sheet, etc.\index{self-monitoring}
It can also be helpful to perform advance troubleshooting: help the client anticipate obstacles and how they will address them.\index{self-monitoring}
For instance, if the client feels that they might forget to do the tracking, have them set a timer.\index{self-monitoring}
Self-monitoring has lower [reliability](#reliability) and [validity](#validity) than behavioral observation, but it is still useful and widely used because it is cheap and easy to obtain lots of information that can lead to behavioral improvement.\index{self-monitoring!reliability}\index{self-monitoring!validity}
## Behavior Rating Scales {#behaviorRatingScales}
Behavior rating scales include self- or informant ratings on a checklist of behaviors assessing particular construct(s).\index{behavior rating scale}\index{self-report}\index{informant report}
An example assessment system that uses behavior rating scales is the Achenbach System of Empirically Based Assessment (ASEBA) that includes the Child Behavior Checklist (CBCL), Teacher's Report Form (TRF), Adult Self-Report, etc.\index{behavior rating scale}\index{Child Behavior Checklist}
The ASEBA is an empirically based assessment of psychopathology, rather than a [DSM](#dsm)-focused assessment.\index{behavior rating scale}\index{Child Behavior Checklist}\index{evidence-based assessment}\index{Diagnostic and Statistical Manual of Mental Disorders}
Behavior rating scales are widely used in research and clinical settings.\index{behavior rating scale}
They are relatively cheap and easy to administer and score.\index{behavior rating scale}
[Item response theory](#irt) techniques reveal issues with different levels of Likert scale anchors of rating scales.\index{Likert scale}\index{behavior rating scale}\index{item response theory}
For example, people assign different meanings to the levels "never", "sometimes", and "a lot".\index{behavior rating scale}
It is often better to have the rater describe or provide the numeric amount.\index{behavior rating scale}
For example: "How many times during the last week did your child physically hit someone else?"\index{behavior rating scale}
Behavior rating scales are typically retrospective where the rater has to reflect back and estimate the frequency of behaviors and people's responses to the environment.\index{behavior rating scale}\index{retrospective}
Retrospective ratings can have challenges with [validity](#validity) due to inaccurate memory recall.\index{behavior rating scale}\index{retrospective}\index{behavior rating scale!validity}
## Assessment of Therapeutic Process {#assessmentTherapeuticProcess}
Other behavioral assessments include assessments of therapeutic process.\index{assessment!of therapeutic process}
Example assessments of therapeutic process include having a video recording of a session and then coding it in a naturalistic setting.\index{assessment!of therapeutic process}
For a therapist, the naturalistic setting is the therapeutic context.\index{assessment!of therapeutic process}
An example of assessment of the therapeutic process could include assessing the clinician's adherence and competence.\index{assessment!of therapeutic process}
Assessing adherence would involve coding whether the therapist is following the treatment protocol and manual, that is, the degree to which the clinician shows treatment fidelity.\index{assessment!of therapeutic process}
Assessing the clinician's competence would involve coding how skilled the therapist is in providing the treatment.\index{assessment!of therapeutic process}
Coding clinician competence in most treatments, including cognitive behavioral therapy, would not be a moment-to-moment coding; instead, the coder would examine the sequence of interactions between client and therapist.\index{assessment!of therapeutic process}
## Conclusion {#conclusion-behavioral}
Examples of behavioral assessment include [naturalistic behavioral observation](#observationApproaches), [analogue (structured) observation](#analogueAssessment), self-monitoring/diary, behavior ratings (e.g., informant report), and self-report.\index{observation!naturalistic}\index{observation!analogue}\index{self-monitoring}\index{behavior rating scale}\index{informant report}\index{self-report}
A gold standard for [naturalistic observations](#observationApproaches) is to observe people in their natural context across more than one day, time, situation, and context with more than one rater to get a more robust sampling of the person's behavior.\index{observation!naturalistic}
Compared to [naturalistic observation](#observationApproaches), [analogue assessments](#analogueAssessment) tend to show greater [reliability](#reliability) and [internal validity](#internalValidity) but lower [external validity](#externalValidity).\index{observation!naturalistic}\index{observation!analogue}\index{observation!reliability}\index{observation!validity}
A useful approach to identify the function of a given behavior is to identify patterns of sequences according to the antecedent-behavior-consequence (A-B-C) model as part of a [functional behavior assessment](#fba).\index{functional behavioral assessment}\index{antecedent-behavior-consequence}
Another useful approach is [self-monitoring](#selfMonitoring), which provides a lot of information at low cost and is therefore a component of most empirically supported treatments.\index{self-monitoring}\index{empirically supported treatment}
## Suggested Readings {#readings-behavioral}
@Girard2016