The Beliefs about Voices Questionnaire – Revised: A factor structure from 450 participants

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Abstract

Hallucinated voices are common across psychiatric and non-clinical groups. The predominant cognitive theory about the impact of voices posits that beliefs about voice power (‘Omnipotence’) and voice intent (‘Malevolence’/‘Benevolence’) play a key role in determining emotional and behavioral reactions. The revised Beliefs about Voices Questionnaire (BAVQ-R) was designed to assess these constructs, together with two styles of responding (Engagement and Resistance). The BAVQ-R is widely used in clinical and research settings, yet it has not received validation of its constructs and factor structure. This study examined the factor structure of the BAVQ-R by combining datasets from five study centers, comprising 450 participants (belief constructs) and 269 participants (response styles), and using confirmatory and exploratory factor analysis. Findings failed to support a three factor belief model, instead showing a two-factor structure (‘Persecutory beliefs’ combining Omnipotence and Malevolence constructs, and a Benevolent construct). Emotional and behavioral items did not separate. Overall, results showed that (i) a two-factor model of beliefs (Persecutory and Benevolent beliefs) provides a better fit to the data than a three-factor model, and (ii) emotional and behavioral modes of responding items should not be separated. Theoretical implications of this finding are discussed in relation to the research and therapy.

Keywords: Hallucinations, Hearing voices, BAVQ, Beliefs about voices, Omnipotence, Malevolence

Highlights

The BAVQ-R was designed to measure beliefs about voices and reactions to voices. Despite widespread use, the factor structure of the BAVQ-R has not been established. A two-factor model of beliefs (Persecutory and Benevolent) provided the best fit. A two-factor model of reactions (Engagement and Resistance) provided the best fit.

1. Introduction

Hearing voices (‘Auditory Verbal Hallucinations’) is commonly reported by people diagnosed with psychiatric conditions such as schizophrenia (Slade and Bentall, 1988), mood disorders (Toh et al., 2015), borderline personality disorder (Slotema et al., 2012), and post-traumatic stress disorder (Butler et al., 1996), as well as in the general (non-clinical) population (Honig et al., 1998). The featural properties of voice hearing (e.g. form, content, impact) appears similar across population groups (Daalman et al., 2011, Slotema et al., 2012), although the emotional and behavioral responses to such experiences vary considerably (Chadwick and Birchwood, 1994, Honig et al., 1998).

Voice content (especially negative content) might not be the only source of individual differences in emotional and behavioral responses to voices (van der Gaag et al., 2003). In their influential cognitive theory, Chadwick and Birchwood (1994) suggested that beliefs held about the purpose and intent of voices play a critical role in determining how people respond and cope with these experiences. In particular, they suggested that beliefs about voice omnipotence (i.e. the perceived power of voices) and voice intent (i.e. perceived malevolent or benevolent intentions of voices) can explain the way that voices are responded to, acted on, and complied with Birchwood and Chadwick, 1997, Chadwick and Birchwood, 1994. Specifically, they specified two broad forms of emotional and behavioral responding; Engagement and Resistance. Whilst some people willingly and actively engage with voices, others attempt to resist voices through arguing, shouting or non-compliance (Chadwick and Birchwood, 1994). Evidence presented in support shows that engagement and resistance appear to have differential associations with distress. Engagement is associated with reduced levels of depression and anxiety whilst resistance is positively associated with these variables (Chadwick et al., 2000).

The 30-item Beliefs about Voices Questionnaire (BAVQ) (Chadwick and Birchwood, 1995) and the subsequent 35-item revised version (BAVQ-R) (Chadwick et al., 2000) were designed to measure these key aspects of the voice hearing experience. The BAVQ-R has three belief subscales: one measuring beliefs about Omnipotence, and two intended to measure beliefs about voice intent – Malevolent beliefs (beliefs about negative intent) and Benevolent beliefs (beliefs about positive intent). There are two further subscales designed to measure Engagement and Resistance response styles, each further subdivided into emotional and behavioral modes of expression.

A factor analysis for the original 30-item BAVQ scale was conducted with 60 participants (Chadwick and Birchwood, 1995), but the factor structure of the 35-item BAVQ-R has not yet been examined despite its wide usage in research and clinical settings (Peters et al., 2012, Shawyer et al., 2012, Thomas et al., 2015). If we are to further understand individual differences in emotional and behavioral responding to voices, and the mediating role of beliefs, empirical evidence is needed to confirm the separation and distinctiveness of the constructs being measured. Furthermore, a better understanding of the factor structure of the BAVQ-R is crucial in order to advance scientific enquiry in the field and design more effective therapies. Clearly delineated constructs can be used to refine psychological interventions to specifically target these constructs and to seek out mechanisms that maintain distress.

The aim of the paper was to establish, for the first time, the factor structure of the BAVQ-R using confirmatory factor analysis and principal component analysis in a large sample comprising data from 450 participants from five study centers.

2. Method

2.1. Design

The study pooled anonymized and de-identified BAVQ-R data from eight independent studies from five study centers providing an adequately sized sample for factor analysis. Each individual study had received ethical approval from their respective ethics committee. Pooling of data from the different studies into the current sample was done by the second author (KH at the University of Bergen, Norway), and was subsequently approved by the Regional Ethical Committee of Western Norway (REK-Vest #2016/576).

2.2. Participants

Table 1 gives detailed information about the participants in this study. There was a combined total of 450 participants contributing data for the belief subscales, with a mean age of 36.88 years (sd = 11.74) and 46% were female. There were 269 participants contributing data for the response subscales. Participants were resident in the UK, Norway, Australia, the USA, Canada or New Zealand. Diagnosis was not an eligibility criterion given the transdiagnostic nature of voice-hearing and the similarity in form, content and characteristics across diagnostic groups (Daalman et al., 2011).

Table 1

Participant information by sub-sample.

a Data from Cole et al. (2017).

b Unpublished data from the Bergen Psychosis 2 project (BP2), Haukeland University Hospital, Bergen, Norway.

c Unpublished data from Falkenberg et al. (2014). d Unpublished data from the Bergen ERC VOICE project, University of Bergen, Norway. e Data from Kråkvik, et al. (2013). f Data from Waters et al. (2003).

g Data from Thomas et al. (2011) and unpublished data from the Voice Exchange project, Melbourne, Australia.

h Data from Sorrell et al. (2010) and unpublished data from Dannahy et al. (2011).

i BAVQ-R items 1–18 (omnipotence, malevolence and benevolence subscales) included, items 19–35 (resistance and engagement subscales) not recorded.

2.3. Measures

2.3.1. Beliefs about Voices Questionnaire – Revised (BAVQ-R) (Chadwick et al., 2000)

The BAVQ-R is a 35 item measure with items rated on a four-point scale from ‘disagree’ (= 0) to ‘strongly agree’ (= 3). Items 1–18 are intended to measure Omnipotence (6 items e.g. “my voice is very powerful”), Malevolence (6 items e.g. “my voice is evil”) and Benevolence (6 items e.g. “my voice wants to protect me”). Items 19–35 are intended to measure responses to voices: Emotional Resistance (4 items e.g. “my voice frightens me”); Behavioral Resistance (5 items e.g. “I tell it to leave me alone”); Emotional Engagement (4 items e.g. “my voice reassures me”) and Behavioral Engagement (4 items e.g. “I listen to it because I want to”). In the original psychometric paper, subscale totals are presented. However, we have chosen to present subscale mean scores (0–3) to allow greater ease of comparison between subscales given that different subscales have different numbers of items.

2.4. Data analyses

Data were available from all 450 participants for the three belief subscales (Omnipotence, Malevolence and Benevolence), and from 269 participants for the two response subscales (Resistance and Engagement). We tested the data set for suitability for factor analyses by doing a Kaiser-Meyer-Olkin (KMO) Measure of Sampling Adequacy test. The KMO returned a value of 0.89, showing our sample is adequate for factor analyses. Separate analyses were conducted with the belief items (analysis 1) and the response items (analysis 2) using normalized varimax rotation of the extracted factors and applying Monte Carlo PCA (parallel criteria analysis) to determine the critical eigenvalue for significant factors (Watkins, 2000). We used AMOS 23.0.0 (build 1607) to conduct confirmatory factor analyses (CFA) to test the models derived from the theory and achieved by the principal component analyses.

For CFA, rules of thumb suggest that the comparative fit index (CFI) should be greater than or close to 0.95 to indicate acceptable fit (Hu and Bentler, 1999). A root mean square error of approximation (RMSEA) value of 0.05 or less is considered a good fit, .08 indicates acceptable fit, and 0.10 or more a poor fit (Browne and Cudeck, 1993). Good fit is also indicated by relative chi-square values (χ 2 /df) of less than or equal to 2 and acceptable fit is indicated by values between 2 and 3 (Schermelleh-Engel et al., 2003), although this method lacks robustness to e.g. large sample sizes, non-normality and large correlations between variables (Kline, 2011). The CFA analyses were performed with Maximum Likelihood estimation. We performed Bollen-Stine bootstrapping to control for non-normality in the data and used differences in χ 2 together with the associated difference in degrees of freedom to compare the different models. This is a recommended approach as the compared models are nested.

Finally, derived factors were explored to ascertain differences between women and men (t-tests), relationship with age (Pearson's correlation), differences between study centers (one-way ANOVA with Bonferroni corrected pairwise comparisons) and differences between studies recruiting only participants with a confirmed diagnosis of a schizophrenia spectrum condition and those studies recruiting mixed diagnostic groups (one-way ANOVA with Bonferroni corrected pairwise comparisons).

3. Results

Table 2 shows the 35 BAVQ-R items along with the item means and standard deviations.

Table 2

BAVQ-R item means and standard deviations.

ItemNMean (0–3)sd
1. My voice is punishing me for something I have done4501.211.21
2. My voice wants to help me4501.141.20
3. My voice is very powerful4501.781.17
4. My voice is persecuting me for no good reason4501.421.21
5. My voice wants to protect me4501.001.15
6. My voice seems to know everything about me4502.091.09
7. My voice is evil4501.481.24
8. My voice is helping to keep me sane4500.761.05
9. My voice makes me do things I really don’t want to do4501.041.15
10. My voice wants to harm me4501.381.26
11. My voice is helping me to develop my special powers or abilities4490.801.07
12. I cannot control my voices4501.851.17
13. My voice wants me to do bad things4501.251.22
14. My voice is helping me to achieve my goal in life4500.731.06
15. My voice will harm or kill me if I disobey or resist it4500.871.15
16. My voice is trying to corrupt or destroy me4501.361.23
17. I am grateful for my voice4500.831.11
18. My voice rules my life4501.161.14
19. My voice reassures me4500.921.13
20. My voice frightens me4501.701.21
21. My voice makes me happy4500.721.05
22. My voice makes me feel down4501.781.16
23. My voice makes me feel angry4501.481.19
24. My voice makes me feel calm4500.690.99
25. My voice makes me feel anxious4501.901.11
26. My voice makes me feel confident4500.731.03
27. I tell it to leave me alone2691.611.25
28. I try and take my mind off it2691.991.11
29. I try and stop it2691.731.25
30. I do things to prevent it talking2691.631.23
31. I am reluctant to obey it2692.011.18
32. I listen to it because I want to2690.991.19
33. I willingly follow what my voice tells me to do2690.771.05
34. I have done things to start to get in contact with my voice2690.771.07
35. I seek the advice of my voice2690.841.14

3.1. Belief items factor structure

An initial CFA, based on the original three-factor theoretical model for the belief items (Malevolence, Omnipotence and Benevolence) (Chadwick et al., 2000) was conducted, assuming independent factors. The analysis yielded a poor model fit (χ 2 /df = 7.24, CFI = 0.77, RMSEA = 0.12) (Gaskin and Lim, 2016). A second analysis, allowing for correlated factors yielded a somewhat better fit between the model and the data (χ 2 /df = 4.38, CFI = 0.88, RMSEA = 0.087). However, there was strong positive correlation (0.83) between Malevolence and Omnipotence items, and several of the Omnipotence items loaded onto more than one factor. This suggests a two-factor structure as more appropriate, with Malevolence and Omnipotence items loading on a single factor which we label ‘Persecutory Beliefs’.

Since the fit of the original theoretical three-factor model was rather modest, we conducted a principal component analysis on items 1–18 of the BAVQ-R (the items designed to measure beliefs about voices) to explore if there was a different factor structure in the existing data. Extraction of principal components, using normalized varimax rotation of variables, revealed 3 factors with eigenvalue > 1 (eigenvalues: 5.959, 3.443, and 1.224). The Monte Carlo PCA analysis however showed a critical eigenvalue of 1.240 for the third factor, which identified a two-factor solution, explaining 52.23% of the common variance. All of the items from the Malevolence and Omnipotence subscales loaded strongly onto Factor 1. Factor 2 consisted items from the Benevolence sub-scale only. Thus, the current analysis favored a two-factor solution, with a Malevolence/Omnipotence factor (Persecutory beliefs about voices) and a Benevolence factor. There were no items without a unique solution. Internal consistency of the Persecutory and Benevolence subscales were excellent (Cronbach α = 0.88 and 0.87 respectively).

A confirmatory factor analysis executed on this new two-factor model however yielded poor goodness of fit (χ 2 /df = 5.01, CFI = 0.86, RMSEA = 0.094). The still rather poor fit with the data could be explained by cross-loadings in the factor solutions, and also to co-variances across several of the Omnipotence items. We therefore ran a third CFA analysis, and as suggested by the change indexes, we omitted three of the Omnipotence items with the highest co-variances (‘my voice is very powerful’, ‘my voices seems to know everything about me’ and ‘I cannot control my voices’) and one Benevolence item (‘my voice is helping me to develop my special powers or abilities’). This resulted in a better fit for a two-factor model (χ 2 /df = 4.19, CFI = 0.93, RMSEA = 0.084), see Fig. 1 . The difference in χ 2 between the theoretically derived three-factor model and the empirically derived two-factor model was significant (χ 2 diff. (56) = 217.0, p < 0.001), showing that the two-factor model was a significantly better fit to the data than the three-factor model. In addition, the final, modified two-factor model show even better fit compared to the theory based three-factor model when independent factors are assumed (χ 2 diff. (61) = 667.80, p < 0.001). The Bollen-Stine bootstrapping suggested fit with the data both for the original three-factor model as well as for the revised two-factor model (Bollen-Stine bootstrap p < 0.001). However, as the average χ 2 for the original three-factor model was 155.2, and the final two-factor model yielded a χ 2 of 91.4, showing that the revised model yielded better fit. In addition, the correlation between the factors was acceptable in this two-factor model (r = − 0.41) showing each of the factors are explaining a reasonable amount of unique variance. The factor loadings for the final two-factor solution are shown in Table 3 , with loadings > 0.40 shown in bold (Hair et al., 1995).

Fig. 1

Factor structure of BAVQ-R belief items. MO = Persecutory beliefs about voices factor (items from original Malevolence and Omnipotence subscales), B = Benevolent beliefs about voices factor, v = BAVQ-R original item number. The number on the far left of the figure is the correlation between the factors, the numbers in the middle of the figure are the factor loadings, and numbers on the far right of the figure represent the explained variance.

Table 3

Factor loadings for beliefs items (1–18).

BAVQ-R item focus (original subscale M, O or B)Factor 1Factor 2
1 Punishment M0.66− 0.04
2 Helpful B− 0.150.81
4 Persecuting M0.55− 0.25
5 Protecting B− 0.090.82
7 Evil M0.72− 0.30
8 Keep me sane B− 0.070.77
9 Make me do things O0.690.03
10 Harm me M0.75− 0.31
13 Bad things M0.69− 0.20
14 Achieve goals B− 0.070.80
15 Harm me O0.71− 0.01
16 Corrupt me M0.76− 0.30
17 Grateful B− 0.210.80
18 Rules my life O0.690.12

Loadings > 0.40 shown in bold; B = Benevolence item in original BAVQ-R; M = Malevolent item in original BAVQ-R; O = Omnipotence item in original BAVQ-R; please note that items 3, 6, 11 and 12 are omitted from the table as they were not retained in the final model.

3.2. Response items factor structure

The response items yielded a KMO of 0.895, and as such the sample should be adequate for factor analyses. A confirmatory factor analysis of the response items, assuming independent factors, yielded a poor model fit (χ 2 /df = 5.20, CFI = 0.75, RMSEA = 0.13). When the analysis was repeated accepting correlated factors, the model yielded a better fit (χ 2 /df = 2.05, CFI = 0.94 and RMSEA = 0.062). However, the correlation between the two Engagement factors were high (0.91), and also the correlation was also high between the two Resistance factors (0.73). This indicates that the two factors are basically measuring the same concept, and the factors cannot be reliably differentiated at a conceptual level. The change indexes suggested there were cross-variance at several levels. Item 32 (“listen willingly”) in particular showed strong cross loads.

To investigate if another factor structure could be found in the data, we conducted a principal components analysis, using normalized Varimax rotation (Costello and Osborne, 2005) on items 19–35 of the BAVQ-R. The analysis revealed 3 factors with eigenvalue > 1 (eigenvalues: 6.240, 2.678, and 1.168). A Monte Carlo PCA analysis (Ledesma and Valero-Mora, 2007) however suggested a critical eigenvalue of 1.289 for the third factor, which identified a two-factor solution, explaining 52.46% of the common variance. Factor 1 consisted of all of the Resistance items and Factor 2 consisted of all of the Engagement items, with no separation found between Emotional and Behavioral Resistance items on either factor. Thus, the PCA favored a two-factor solution, corresponding to Resistance and Engagement subscales with items measuring emotional and behavioral responding loading together. There were no items without a unique solution. Internal consistency of the Engagement and Resistance subscales was excellent (Cronbach α = 0.87 and 0.88 respectively).

When testing this two-factor solution (Resistance and Engagement) with a CFA, and with control for covariance within the factors, the results yielded a reasonable model fit. However, two behavioral engagement items (‘I listen to it because I want to’ and ‘I willingly follow what my voice tells me to do’) showed strong cross loadings with the other factor. When they were removed from the model, and correlations between variables were controlled for, the analysis suggested a good model fit (the χ 2 /df = 2.20, CFI increased to 0.94, and RMSEA = 0.066). Stine-Bollen bootstrapping also confirmed we had reached a reliable model. The modified two-factor model yielded a better fit with the data compared to the theoretically derived four-factor model (χ 2 diff. (33) = 429.3, p < 0.001), and also different from the four factor model with assumed correlated factors (χ 2 diff. (27) = 43.5, p < 0.05), see Fig. 2 . In addition, the correlation between the two factors was acceptable (r = − 0.42), showing each factor has unique contribution to the explained variance. The factor loadings for the final two-factor solution are shown in Table 4 , where loadings > 0.40 are shown in bold

Fig. 2

Factor structure of BAVQ-R response items. E = Engagement factor, R = Resistance factor, v = BAVQ-R original item number. The number on the far left of the figure is the correlation between the factors, the numbers in the middle of the figure are the factor loadings, and numbers on the far right of the figure represent the explained variance.

Table 4

Factor loadings for responding items (19–35).

BAVQ-R item focus (Original subscale Re, Rb, Ee, Eb)Factor 1Factor 2
19 Reassures me Ee− 0.210.73
20 Frightens me Re0.72− 0.10
21 Makes me happy Ee− 0.200.69
22 Makes me down Re0.75− 0.16
23 Makes me angry Re0.70− 0.06
24 Makes me calm Ee− 0.220.78
25 Makes me anxious Re0.75− 0.17
26 Makes me confident Ee− 0.170.76
27 Tell leave alone Rb0.72− 0.10
28 Take mind off it Rb0.62− 0.15
29 Try and stop Rb0.67− 0.11
30 Prevent it Rb0.72− 0.08
31 Reluctant to obey Rb0.62− 0.25
34 Try to contact Eb0.000.65
35 Seek advice Eb− 0.110.81

Loadings > 0.40 shown in bold; Re = Emotional resistance item in original BAVQ-R; Rb = behavioral resistance item in original BAVQ-R; Ee = Emotional engagement item in original BAVQ-R; Eb = Behavioral engagement item in original BAVQ-R; please note that items 32 and 33 are omitted from the table as they were not retained in the final model.

3.3. Demographic and diagnostic associations with newly derived factors

Table 5 shows the newly derived factor means and standard deviations (29 items) by gender, age and sample. Women had significantly higher scores than men on the Persecutory and Resistance factors suggesting that women both hold stronger persecutory beliefs about voices than men and that they are more likely to employ resistance responses. There were no gender differences in Benevolence or Engagement and age was not associated with scores on any of the factors. Finally, Bonferroni corrected pairwise comparisons using one-way ANOVA between the eight samples showed no significant differences in means on the newly derived factors between sites.

Table 5

Means and standard deviations on newly derived factors (29 items) by gender, age, site and diagnosis.

a Unpublished data from Relationships and Recovery in Psychosis project (RRP), University of Surrey, UK.

b Unpublished data from the Bergen Psychosis 2 project (BP2), Haukeland University Hospital, Bergen, Norway.

c Unpublished data from Falkenberg et al. (2014) 35 . d Unpublished data from the Bergen ERC VOICE project, University of Bergen, Norway. e Data from Kråkvik et al. (2013) 36 . f Data from Waters et al. (2003) 37 .

g Data from Thomas et al. (2011) 38 and unpublished data from the Voice Exchange project, Melbourne, Australia.

h Data from Sorrell et al. (2010) 39 and unpublished data from Dannahy et al. (2011) 31 .

* Significant Bonferroni corrected t-tests (between women and men; between studies recruiting only people with schizophrenia-spectrum diagnosis and studies recruiting mixed-diagnosis samples); Bonferroni corrected Pearson's r correlations (with age); and one-way ANOVA Bonferroni corrected pairwise differences (between study sites).

There were no differences on any of the newly derived factors between those studies recruiting only participants with a confirmed diagnosis of a schizophrenia spectrum condition and those studies recruiting mixed diagnostic groups (see Table 1 ). There were no differences between these two sets of studies on subscale scores of Persecutory beliefs, Benevolence beliefs, Engagement or Resistance.

4. Discussion

The Beliefs about Voices Questionnaire – Revised (BAVQ-R) (Chadwick et al., 2000) was developed to measure key aspects of the voice hearing experience as identified in Chadwick and Birchwood's (1994) cognitive theory. Whilst their theory suggested that three types of beliefs exist (Omnipotence, Malevolence and Benevolence), the current factor analysis failed to support separation between Omnipotence and Malevolence, with items loading onto a single factor which we have termed Persecutory beliefs and with this requiring removal of three Omnipotence items. Support however was found for Benevolence being a distinct factor.

When it comes to items measuring responding to voices, the use of Resistance and Engagement subscales in the original BAVQ-R was supported in the current analysis following removal of two Engagement items, although we found no support for the separation of emotional and behavioral modes of responding in either subscale. There are a number of theoretical, clinical and research implications of these findings which are explored below.

4.1. Implications

Items measuring omnipotent and malevolent beliefs about voices did not separate but instead correlated strongly with each other. This suggests that voice characteristics of perceived power and perceived hostile intent tend to cluster together and measure the same construct. This finding has also been observed when participants rate their voices on measures of interpersonal relating (Thomas et al., 2009), although it contrasts with the broader literature on social interactions in which power (or dominance) and hostility form two distinct, orthogonal, dimensions (Kiesler, 1996). This suggests differences in the interpersonal relationship of individuals with voices relative to their relationships to people. Perhaps dominance and hostility typically become merged in the context of hallucinated distressing voices. This explanation is also consistent with a developmental perspective which suggests that people distressed by hearing voices are disproportionately likely to have experienced childhood sexual or physical abuse (Read et al., 2005), and to have been a victim of bullying (Kråkvik et al., 2015). Beliefs about voices are related to broader interpersonal schema (Birchwood et al., 2004, Thomas et al., 2015), which are thought to be shaped by such early life experiences (Beck, 2005). Hence, persecutory beliefs about voices may reflect early experiences of being overpowered by an abuser or bully who intends harm. Indeed, there is growing interest in applying post-traumatic stress disorder theories and interventions to people experiencing psychosis (van den Berg and van der Gaag, 2012) as the relationship between early trauma and later psychotic experiences is becoming more firmly established.

The tendency to respond to voices either by resisting them or by engaging with them emerged as separate factors. However, the separation of emotional and behavioral modes of expression was not supported, corroborating Chadwick's (2006) suggestion that the subdivision between emotional and behavioral items may not be necessary: “emotion and behavior scores can either be totaled to give one overall score for Resistance and Engagement or looked at separately, or both” (p. 176).

It is of note that resistant responding to voices is associated with anxiety and depression (Chadwick et al., 2000) and this has important clinical implications. ‘Third-wave’ cognitive behavior therapies emphasize the potentially counterproductive effects of attempting to resist unpleasant experiences. Rather than trying to resist voices, mindfulness-based approaches and Acceptance and Commitment Therapy encourage non-judgmental acceptance of voice hearing experiences (Chadwick et al., 2016, Dannahy et al., 2011, Shawyer et al., 2012, Strauss et al., 2015, Thomas et al., 2014) and so lend themselves well as therapeutic approaches to reducing voice resistance.

Whilst age did not correlate with scores on the newly derived subscales, gender differences were found, with women scoring more highly than men on the Persecutory and Resistance subscales (with no gender differences on the other subscales). It would be premature to overly interpret this post-hoc finding but it fits with the suggestion that voice hearing experiences may differ between women and men (McCarthy-Jones et al., 2015). This suggestion warrants future research attention in order to develop and test hypotheses regarding the underlying mechanism for potential gender differences and to replicate the current findings in a new sample.

The original BAVQ-R study was restricted to people with diagnoses on the schizophrenia spectrum (Chadwick et al., 2000). Diagnosis was not an eligibility criterion for this study. There were no differences in ratings for Persecutory beliefs, Benevolence beliefs, Engagement or Resistance between those studies recruiting only participants with a confirmed diagnosis of a schizophrenia spectrum condition and studies recruiting mixed diagnostic groups. This finding adds weight to the hypothesis of the transdiagnostic nature of voice hearing and the similarity in form, content and characteristics across diagnostic groups (Daalman et al., 2011).

It is important to note that these findings apply to group-level data and that individual experiences will vary. Some people, for example, will experience voices as both omnipotent and benevolent. Whilst at the group-level omnipotence items and malevolence items loaded together, this does not mean that everyone who experiences voices as omnipotence will also experience them as malevolent. This underlines the need for careful assessment and formulation when working therapeutically and not to make assumptions based on group-level findings.

4.2. Strengths and limitations

A strength of this study is that it included a sufficiently large sample to conduct principal components analysis. Indeed, with 450 participants for the beliefs items, this is the largest BAVQ-R dataset that has been reported in the literature to our knowledge. The large sample also allowed for sub-sample differences to be explored regarding gender and age that could be taken forward and explored in more detail in future studies.

A potential limitation of the study is the methodological differences between the eight studies included in the factor analysis. Participants in these studies were drawn from different settings (e.g. through community mental health teams, through the Hearing Voices Network), different countries and there were differences between the samples in terms of diagnostic status and educational attainment. However, this could also be seen as a strength of the study as the broad range of recruitment strategies resulted in a diverse sample of voice hearers which perhaps lends itself particularly well when attempting to explore the underlying factor structure of a measure. Also, the samples did not differ from each other on any of the newly derived subscales, so, although the samples were different demographically they were not different in terms of beliefs about voices or in ways of responding to voices. Moreover, there were no differences in subscale scores between the studies where all participants had a confirmed diagnosis of a schizophrenia spectrum condition and those studies recruiting mixed diagnostic groups.

There are potential limitations with BAVQ-R items. Two omnipotence items imply malevolent voice intent (“my voice makes me do things I really don’t want to do” and “my voices will harm or kill me if I disobey or resist it”) which may explain in part why these items loaded together. Future research could develop omnipotence items which do not imply either malevolent or benevolent intent in order to further explore the overlap found in the current study between omnipotence and malevolence. The final models provided the best fit to the data amongst the models tested, with fit statistics being in the acceptable range for the final derived two belief factors and two response factors. To further aid the measurement of the proposed constructs in a more precise and coherent way, future research could aim to improve model fit by developing new items. However, the BAVQ-R is widely used and no other more psychometrically robust measure of beliefs of voices exists to our knowledge. The current study provides empirical support for using a 29-item version of the BAVQ-R in clinical practice and in research settings. There were a few missing data from some studies for some of the BAVQ-R items and in some cases full demographic information was not available. The eight studies also did not use a consist set of additional measures to allow convergent and divergent validity of the newly derived factors to be tested in the full sample of 450 participants. However, because the overall sample was so large the analyses with missing data were still adequately powered to detect medium effect sizes.

There is growing interest in third-wave CBT approaches for psychosis which focus on the relationship with psychotic experiences such as hearing voices, and emphasize the role of mindfulness, acceptance, self-compassion and values-directed action. It could be argued that second-wave CBT constructs such as ‘beliefs about voices’ are losing their relevance and that attention to measurement of these constructs is therefore unnecessary. However, despite the growing interest in third-wave CBT for psychosis, a recent meta-analysis of randomised-controlled trials showed small-medium effects on psychotic symptom severity and depression, and non-significant effects on functioning and voice-related distress (Louise et al., 2017). It would be premature therefore to abandon second-wave CBT for psychosis in favour of third-wave approaches. The largest randomised controlled trial in this area, evaluating a second-wave CBT approach for commanding voices, showed significant effects on the primary outcome (compliance) (Birchwood et al., 2011), suggesting that these approaches are still worthy of implementation and further investigation. We suggest therefore that constructs central to second-wave CBT for distressing voices – namely beliefs about voices – still require valid and reliable methods of assessment.

4.3. Conclusions

A factor structure for the BAVQ-R is suggested where Malevolence and Omnipotence items are combined into a single Persecutory beliefs factor, and whilst Resistance and Engagement subscales were confirmed, further separation of these into behavioral and emotional subscales is not warranted from the data. We suggest that the 29 BAVQ-R items contributing to the final factor structure could be used in future clinical practice and research. This revised factor structure will hopefully facilitate future research exploring the mechanisms involved in causing voice-distress and when evaluating therapeutic change mechanisms.

Acknowledgements

We would like to thank all the participants who took part in the studies that contributed to this paper. In addition, we would also like to thank the researchers who helped to collect the data for the studies included in this paper: Alison Holt, Esther Cole and Eleanor Sorrell (University of Surrey, UK); Jill Bjarke, Lena A. Stabell, Eirik Kjelby and Farivar Fathian (Bergen, Norway); Rolf Wilhelm Gråwe (St. Olav's University Hospital, Trondheim, Norway); or who contributed to earlier studies in which the data were collected: Johanna Badcock, Murray Mayberry and Patricia Mitchie (University of Western Australia, Australia).

Conflicts of interest

Funding

Studies included in this paper received funding as follows: Norwegian Research Council (#213727) and the Western Norway Regional Health Authority (# 911820) grant to Erik Johnsen; Research Council of Norway (RCN) Grants #196076/V50 and #223273 to Kenneth Hugdahl; and European Research Council (ERC) Advanced Grants #249516 and #693124 to Kenneth Hugdahl.

References

Beck A.T. The current state of cognitive therapy: a 40-year retrospective. Arch. Gen. Psychiatry. 2005; 62 :953–959. [PubMed] [Google Scholar]

Birchwood M., Chadwick P. The omnipotence of voices: testing the validity of a cognitive model. Psychol. Med. 1997; 27 :1345–1353. [PubMed] [Google Scholar]

Birchwood M., Gilbert P., Gilbert J., Trower P., Meaden A., Hay J., Murray E., Miles J.N.V. Interpersonal and role-related schema influence the relationship with the dominant “voice” in schizophrenia: a comparison of three models. Psychol. Med. 2004; 34 :1571–1580. [PubMed] [Google Scholar]

Birchwood M., Peters E., Tarrier N., Dunn G., Lewis S., Wykes T., Davies L., Lester H., Michail M. A multi-centre, randomised controlled trial of cognitive therapy to prevent harmful compliance with command hallucinations. BMC Psychiatry. 2011; 11 :155. [PMC free article] [PubMed] [Google Scholar]

Browne M.W., Cudeck R. Alternative ways of assessing model fit. In: Bollen K.A., Long J.S., editors. Testing Structural Equation Models. Sage; Beverly Hills, CA: 1993. pp. 136–162. [Google Scholar]

Butler R.W., Mueser K.T., Sprock J., Braff D.L. Positive symptoms of psychosis in posttraumatic stress disorder. Biol. Psychiatry. 1996; 39 :839–844. [PubMed] [Google Scholar]

Chadwick P. Wiley; London: 2006. Person-based Cognitive Therapy for Distressing Psychosis. [Google Scholar]

Chadwick P., Birchwood M. The omnipotence of voices. Br. J. Psychiatry. 1994; 164 :190–201. [PubMed] [Google Scholar]

Chadwick P., Birchwood M. The omnipotence of voices. II: the Beliefs About Voices Questionnaire (BAVQ) Br. J. Psychiatry. 1995; 166 :773–776. [PubMed] [Google Scholar]

Chadwick P., Lees S., Birchwood M. The revised Beliefs About Voices Questionnaire (BAVQ-R) Br. J. Psychiatry. 2000; 177 :229–232. [PubMed] [Google Scholar]

Chadwick P., Strauss C., Jones A.-M., Kingdon D., Ellett L., Dannahy L., Hayward M. Group mindfulness-based intervention for distressing voices: a pragmatic randomised controlled trial. Schizophr. Res. 2016; 175 :168–173. [PMC free article] [PubMed] [Google Scholar]

Costello A., Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005; 10 :1–9. [Google Scholar]

Cole E.R., Strauss C., Fife‐Schaw C., McCarthy‐Jones S. Echoes of others: A path analytic examination of an interpersonal–cognitive model of voice‐related distress. Psychology Psychotherapy: Theory, Res. Pract. 2017 [PubMed] [Google Scholar]

Daalman K., Boks M.P.M., Diederen K.M.J., de Weijer A.D., Blom J.D., Kahn R.S., Sommer I.E.C. The same or different? A phenomenological comparison of auditory verbal hallucinations in healthy and psychotic individuals. J. Clin. Psychiatry. 2011; 72 :320–325. [PubMed] [Google Scholar]

Dannahy L., Hayward M., Strauss C., Turton W., Harding E., Chadwick P. Group person-based cognitive therapy for distressing voices: pilot data from nine groups. J. Behav. Ther. Exp. Psychiatry. 2011; 42 :111–116. [PubMed] [Google Scholar]

Falkenberg L.E., Westerhausen R., Craven A.R., Johnsen E., Kroken R.A., Løberg E.M., Specht K., Hugdahl K. Impact of glutamate levels on neuronal response and cognitive abilities in schizophrenia. NeuroImage: Clin. 2014; 4 :576–584. [PMC free article] [PubMed] [Google Scholar]

Gaskin, J., Lim, J., 2016. Model Fit Measures (AMOS Plugin).

Hair J.F., Anderson R.E., Tatham R.L., Black W.C. 4th ed. Prentice-Hall, Inc.; Harlow, Essex, UK: 1995. Multivariate Data Analysis. [Google Scholar]

Honig A., Romme M., Ensink B., Escher S., Pennings M., Devries M. Auditory hallucinations: a comparison between patients and nonpatients. J. Nerv. Ment. Dis. 1998; 186 :646–651. [PubMed] [Google Scholar]

Hu L., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. A Multidiscip. J. 1999; 6 :1–55. [Google Scholar]

Kiesler D.J. Wiley; New York, New York: 1996. Contemporary Interpersonal Theory and Research: Personality, Psychopathology, and Psychotherapy. [Google Scholar]

Kline R.B. Guilford Press; New York, New York, US: 2011. Principles and Practice of Structural Equation Modeling. [Google Scholar]

Kråkvik B., Stiles T., Hugdahl K. Experiencing malevolent voices is associated with attentional dysfunction in psychotic patients. Scand. J. Psychol. 2013; 54 (2):72–77. [PMC free article] [PubMed] [Google Scholar]

Kråkvik B., Larøi F., Kalhovde A.M., Hugdahl K., Kompus K., Salvesen Ø., Stiles T.C., Vedul-Kjelsås E. Prevalence of auditory verbal hallucinations in a general population: a group comparison study. Scand. J. Psychol. 2015; 56 :508–515. [PMC free article] [PubMed] [Google Scholar]

Ledesma D.R., Valero-Mora P. Determining the number of factors to retain in EFA: an easy-to use computer program for carrying out parallel analysis. Pract. Assess. Res. Eval. 2007; 12 :1–11. [Google Scholar]

Louise S., Fitzpatrick M., Strauss C., Rossell S.L., Thomas N. Mindfulness- and acceptance-based interventions for psychosis: our current understanding and a meta-analysis. Schizophr. Res. 2017 [PubMed] [Google Scholar]

McCarthy-Jones S., Castro Romero M., McCarthy-Jones R., Dillon J., Cooper-Rompato C., Kieran K., Kaufman M., Blackman L. Hearing the unheard: an interdisciplinary, mixed methodology study of women's experiences of hearing voices (auditory verbal hallucinations) Front. Psychiatry. 2015; 6 :181. [PMC free article] [PubMed] [Google Scholar]

Peters E.R., Williams S.L., Cooke M.a., Kuipers E. It's not what you hear, it's the way you think about it: appraisals as determinants of affect and behaviour in voice hearers. Psychol. Med. 2012; 42 :1507–1514. [PubMed] [Google Scholar]

Read J., van Os J., Morrison a.P., Ross C.a. Childhood trauma, psychosis and schizophrenia: a literature review with theoretical and clinical implications. Acta Psychiatr. Scand. 2005; 112 :330–350. [PubMed] [Google Scholar]

Schermelleh-Engel, Moosbrugger H., Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. 2003:8. [Google Scholar]

Shawyer F., Farhall J., Mackinnon A., Trauer T., Sims E., Ratcliff K., Larner C., Thomas N., Castle D., Mullen P., Copolov D. A randomised controlled trial of acceptance-based cognitive behavioural therapy for command hallucinations in psychotic disorders. Behav. Res. Ther. 2012; 50 :110–121. [PubMed] [Google Scholar]

Slade P.D., Bentall R.P. Croom Helm; Baltimore, Maryland, US: 1988. Sensory Deception: A Scientific Analysis of Hallucination. [Google Scholar]

Slotema C.W., Daalman K., Blom J.D., Diederen K.M., Hoek H.W., Sommer I.E.C. Auditory verbal hallucinations in patients with borderline personality disorder are similar to those in schizophrenia. Psychol. Med. 2012; 42 :1873–1878. [PubMed] [Google Scholar]

Sorrell E., Hayward M., Meddings S. Interpersonal processes and hearing voices: a study of the association between relating to voices and distress in clinical and non-clinical hearers. Behav. Cogn. Psychother. 2010; 38 (2):127–140. [PubMed] [Google Scholar]

Strauss C., Thomas N., Hayward M. Can we respond mindfully to distressing voices? A systematic review of evidence for engagement, acceptability, effectiveness and mechanisms of change for mindfulness-based interventions for people distressed by hearing voices. Front. Psychol. 2015; 6 :1154. [PMC free article] [PubMed] [Google Scholar]

Thomas N., McLeod H.J., Brewin C.R. Interpersonal complementarity in responses to auditory hallucinations in psychosis. Br. J. Clin. Psychol. 2009; 48 :411–424. [PubMed] [Google Scholar]

Thomas N., Rossell S., Farhall J., Shawyer F., Castle D. Cognitive behavioural therapy for auditory hallucinations: effectiveness and predictors of outcome in a specialist clinic. Behav. Cogn. Psychother. 2011; 39 :129–138. [PubMed] [Google Scholar]

Thomas N., Shawyer F., Castle D.J., Copolov D., Hayes S.C., Farhall J. A randomised controlled trial of acceptance and commitment therapy (ACT) for psychosis: study protocol. BMC Psychiatry. 2014; 14 :198. [PMC free article] [PubMed] [Google Scholar]

Thomas N., Farhall J., Shawyer F. Beliefs about voices and schemas about self and others in psychosis. Behav. Cogn. Psychother. 2015; 43 :209–223. [PubMed] [Google Scholar]

Toh W.L., Thomas N., Rossell S.L. Auditory verbal hallucinations in bipolar disorder (BD) and major depressive disorder (MDD): a systematic review. J. Affect. Disord. 2015; 184 :18–28. [PubMed] [Google Scholar]

van den Berg D.P.G., van der Gaag M. Treating trauma in psychosis with EMDR: a pilot study. J. Behav. Ther. Exp. Psychiatry. 2012; 43 :664–671. [PubMed] [Google Scholar]

van der Gaag M., Hageman M.C., Birchwood M. Evidence for a cognitive model of auditory hallucinations. J. Nerv. Ment. Dis. 2003; 191 :542–545. [PubMed] [Google Scholar]

Waters F., Badcock J., Maybery M., Michie P. Inhibition in schizophrenia: association with auditory hallucinations. Schizophr. Res. 2003; 62 :275–280. [PubMed] [Google Scholar]