Treatment fidelity in the Camden Weight Loss (CAMWEL) intervention assessed from recordings of advisor-participant consultations
BMC Obesity volume 5, Article number: 24 (2018)
Variations in the delivery of content and process can alter the effectiveness of complex interventions. This study examined the fidelity of a weight loss intervention (Camden Weight Loss) from recorded consultations by assessing advisors’ delivery of content, use of motivational interviewing approach and therapeutic alliance.
A process evaluation was conducted of advisor-participant consultations in a 12-month randomised controlled trial of an intervention for adult volunteers with a body mass index categorised as overweight or obese. A convenience sample of 22 consultations (12% of 191 participants) recorded at the intervention mid-point were available for analysis. Consultations were independently rated by two observers independent of intervention or study delivery, using: a fidelity scale, the Motivational Interviewing Treatment Integrity Scale and the Primary Care Therapy Process Rating Scale. Raters were blind to participants’ responses to the intervention and weight outcomes. Half the participants (N = 11) achieved significant weight loss (≥ 5% of baseline weight).
A mean of 41% of prescribed content was delivered, with a range covered per session of 8–98%, falling below the 100% content expected per session. Tasks included most frequently were: taking weight and waist measurements (98%), scheduling next appointment (86%), review of general progress (85%) and reviewing weight change (84%). Individual items most frequently addressed were ‘giving encouragement’ and ‘showing appreciation of participant’s efforts’ (95 and 88% respectively). Consultation length (mean 19 min, range 9–30) was shorter than the 30-min allocation. Quantity of content correlated with consultation length (p < 0.01). Advisors’ use of motivational interviewing was rated at ‘beginner proficiency’ for Global Clinician Rating, Reflection to Question Ratio and Percent Open Questions. Therapeutic alliance scores were moderate. Affective aspects were rated highly (e.g. supportive encouragement, involvement and warmth).
Intervention fidelity varied in both content and process, emphasising the importance of ongoing fidelity checks in a complex intervention. Advisors focused on certain practical aspects of the intervention and providing an encouraging interpersonal climate. This concurs with other research findings, which have revealed the value participants in a weight loss intervention place on an empathic advisor-participant relationship.
Clinical trials registration
Registered with Clinicaltrials.gov, number NCT00891943, on 1 May 2009.
The increasing impact of obesity on health has caused international alarm [1, 2]. It is estimated that 2.8 million people die annually due to overweight or obesity . In the UK, 65% of men, 58% of women and 33% of children aged 10–11 are overweight or obese . Health problems related to obesity are estimated to cost the UK National Health Service £5 billion per year .
Guidance recommends multi-component weight management interventions focusing on dietary intake, physical activity and behaviour change, and that behaviour modification addresses: ‘problem solving; goal setting; how to carry out a particular task or activity; planning to provide social support or make changes to the social environment; self-monitoring of weight and behaviours that can affect weight; and feedback on performance’ . Affective features of weight management interventions are also highlighted, emphasising empathy, support and encouragement, and a respectful and non-judgemental approach.
Guidance reflects the complexity of evidence about weight management and the theoretical basis for behaviour change [6,7,8,9,10,11,12]. Multi-component interventions are superior to single-component interventions and result in greater longer term weight loss than control conditions [7, 8]. However, intervention success varies, with variation not accounted for by participant characteristics or programme components (such as length, intensity or face-to-face contact). Long term weight loss remains a challenge [9, 12, 13].
Behaviour change interventions aim to encourage people to self-manage their weight in the long term. Motivational interviewing aims to support this by identifying and enhancing an individual’s own motivation and self-efficacy. The health professional employs an empathic, supportive and collaborative approach, emphasising the individual’s autonomy and encouraging the person to explore their own reasons for, and ambivalence about, changing the target behaviour .
Whilst motivational interviewing is effective in promoting behaviour change, many health professionals are ‘generalists’, using a variety of approaches rather than a single, ‘pure’ approach. ‘Motivational interviewing-style’ approaches, which employ some of the elements (such as empathy) without using the full range of techniques, have been investigated . Weight management programmes including either pure or adapted forms of motivational interviewing improve outcomes relative to traditional behaviour change interventions or control conditions [16, 17]. However, in primary care consultations with patients who were overweight or obese, low levels of techniques consistent with a motivational interviewing approach were observed, specifically empathy and motivational interviewing ‘spirit’ .
The importance of the quality of the therapeutic relationship on outcomes of behaviour change interventions has also been recognised . Therapeutic alliance includes affective aspects of the professional-patient relationship (such as empathy, rapport and warmth) and instrumental aspects (such as agreement on goals and tasks). Baldwin and colleagues highlighted the impact of therapeutic alliance in weight management outcomes, and noted importance of the professional’s contribution to developing this alliance .
Weight management interventions require professionals to skilfully select and deliver elements in line with evidence and an individual’s needs. The importance of initial training and continuing professional development has been highlighted . Key features to promote fidelity (defined as the degree to which an intervention is delivered as intended) are staff training, supervision and an intervention manual . Failure to implement the intervention as designed can result in a ‘Type III error’, where study results do not reflect the effects of the planned intervention . Fidelity includes exposure, adherence to content and quality of delivery . It is commonly assessed by trained observers, either live or from recordings [16, 21, 23]. For example, one study of fidelity in a behaviour change intervention for diabetes found that staff training improved motivational interviewing spirit .
In a 12-month weight loss intervention trial for obese and overweight volunteers, a third of the intervention group achieved clinically significant weight loss (5% or more of their baseline weight) . The present study was designed to examine intervention fidelity, to explore whether differences in intervention delivery may have contributed to variability in intervention group outcome.
To investigate weight loss intervention fidelity through assessing the content and process of advisor-participant consultations. Specifically, to establish whether: (i) intervention topics and activities were delivered as intended; (ii) advisors’ consultation style was consistent with approaches to support lifestyle behaviour change, in particular, using a motivational interviewing approach and establishing a therapeutic alliance.
This was an independent evaluation examining fidelity of a multi-component weight loss intervention delivered by health advisors to participants with weight categorised as overweight and obese, in the intervention arm of a pragmatic randomised control trial in primary care. This was a descriptive, observational study, conducting a process evaluation using independent, blind ratings of recorded advisor-participant consultations. Fidelity of intervention content (scheduled topics and activities) and process (motivational interviewing and therapeutic alliance) were examined. Recordings were taken from the mid-point of the intervention to: (i) assess the therapeutic relationship that had developed, (ii) reduce the influence of participants’ and advisors’ awareness of intervention outcome (i.e. final weight change).
Participants were adults attending the 12-month Camden Weight Loss programme during a two year research period. Consultations were recorded during a five month period. Written consent was obtained from all participants. Out of 191 participants who received the intervention, 104 audio or video-recordings were obtained for 42 participants during the recording period. Including only participants for whom final weight outcomes were available resulted in 34 participants. Of these, recordings from the three mid-intervention sessions were available for 27 participants. Due to problems with sound quality, recordings from five participants were excluded, resulting in a total sample of 22 participants (12% of 191).
The 22 participants were 10 women and 12 men, predominantly White British/White Other (17 participants), with a mean age of 53 years (range 26–80 years) and a mean body mass index at baseline of 32.6 (range 25.2–45.1). At outcome (12 months), 11 had achieved clinically significant weight loss (5% or more of baseline weight) and 11 had not. The 22 participants did not significantly differ from the other 169 trial participants in the intervention arm for: age, baseline weight, waist or body mass index, or final weight loss, but were more likely to be male (12/22 compared to 42/169, Chi2(1) = 8.5, p < 0.01) and to complete more sessions (mean 10.9 compared to 7.4, t(158) = 3.5, p < 0.01).
The weight loss intervention
The Camden Weight Loss programme was offered to adults with weight categorised as clinically overweight or obese in primary care practices in a research trial . The trial aimed to develop a locally delivered weight loss intervention, in line with the National Health Service Health Trainers Initiative , drawing health advisors from local communities, who are trained to support people in adopting healthier lifestyles by using psychological techniques to promote behaviour change. These techniques include supporting others to: choose a behaviour to change, set ‘SMART’ goals, plan behaviour change, improve confidence, review behaviour change, and embed behaviour change into their lifestyle . The intervention was devised as a multi-component programme to promote behaviour change in line with National Institute for Health and Care Excellence guidance  and based on behaviour change models (Social Cognitive Theory, Goal Setting, Systems Thinking) [28,29,30]. Baseline and final weight were measured by research staff. The results of the randomised controlled trial of 381 participants, which included the 191 participants in the intervention arm, are published elsewhere .
Six advisors with a background in health care or exercise were trained to deliver a structured one-to-one intervention. The recordings included five of the advisors: one nurse, two osteopaths and two qualified personal fitness trainers, one of whom also had training in nutrition (CYQ Central YMCA Qualification Level 3 Award). Each participant was allocated to one advisor and were scheduled to attend 14 sessions, lasting 30 min per session, over 12 months in a primary care setting. The session length was intended to enable more in-depth discussion of weight management than is possible in a standard National Health Service primary care consultation (10 min), whilst being delivered to participants in their local practice. Sessions 9, 10 and 11 straddled the intervention mid-point (6 months).
Advisors attended two days of training, including:
the intervention design and rationale
effective behaviour change strategies and principles of motivational interviewing
simulated practice in setting weight loss goals, talking about weight and behaviour change and addressing difficult issues.
Advisors were given a detailed manual listing the goals and content of each session, including handouts for participants in some sessions, and a 20-page booklet on Helping People Change Behaviour, including worked examples of techniques for: motivational interviewing, agenda setting, assessing importance and confidence, listening and informing. During the intervention, advisors attended additional group meetings, including further training in motivational interviewing techniques, and met with research staff individually to discuss intervention progress and any issues in intervention delivery.
Each consultation included a review of progress, recording and reviewing pedometer counts, taking weight and waist measurements, reviewing weight loss progress, introducing a new topic, goal setting, making an action plan and confirming the next appointment. The review included discussing the participant’s experience and success with the previous session’s topic. The intervention schedule is shown in Table 1. Sessions were delivered on a regular schedule with tapering frequency: fortnightly for 12 weeks, 3-weekly to 27 weeks, 4-weekly to 35 weeks and a 12-week interval to the last session. Further details of the intervention are published elsewhere . The topics addressed in sessions 9, 10 and 11 were: positive and negative thinking, responding to situations where you might ‘slip up’, social eating, and staying on course in the long term.
Checklists were devised for the three sessions by itemising the session content from the manual, using the same wording for items repeated across sessions. Eight topics were included in every session: (1) reviewing overall progress, (2) reviewing previous topic and handouts, (3) reviewing pedometer counts and physical activity, (4) taking weight and waist measurements, (5) reviewing weight change, (6) presenting new topic, (7) setting goals, making action plans and assigning home activities, (8) setting date of next appointment. Due to the detail in the manual, the initial checklists contained 41, 40, and 52 items respectively for the three sessions. The final checklist for session 9 is shown in Table 2 as an example.
The checklist was piloted using a scoring key of 0 (not done), 1 (partially done) and 2 (completely done) for most of the items (e.g. ‘feedback is given on performance’), with some simple items (e.g. ‘waist circumference is measured’) assessed on a binary scale of 0 (not done) and 1 (done). However, low frequency and brevity of advisor behaviours observed during piloting indicated that measurement was better suited to assessing the presence of behaviours in comparison to expected content, rather than a combination of presence and quality. The scoring key for all items was converted to a binary scale (done/not done). An additional category (‘not recorded’) noted where items could not be rated due to poor sound quality. A rater crib sheet specified item content, including strategies or examples the advisors had been encouraged to use.
The Motivational Interviewing Treatment Integrity Scale  assesses adherence to and competence in using motivational interviewing, with good inter-rater reliability reported [32, 33]. Global ratings are made for five dimensions: Evocation, Collaboration, Autonomy/Support, Direction and Empathy on a 5-point scale, and a summary score: Spirit of Motivational Interviewing. Behaviour counts are made for seven aspects: Giving Information, Closed Questions, Open Questions, Simple Reflections, Complex Reflections, Motivational Interviewing Adherent Behaviours and Motivational Interviewing Non-adherent Behaviours. Further summary scores are also computed.
The 14-item Alliance scale of the Primary Care Therapy Process Rating Scale  assesses the quality of the professional-patient therapeutic bond in psychological interventions conducted in primary care settings. It was designed for research into treatment fidelity and process-outcome relationships and has good internal consistency (Cronbach’s alpha 0.88). Items are scored on a 7-point scale, with anchors at four points (not at all, somewhat, considerably, extensively).
Raters were blind to participants’ weight loss outcomes. The raters (LA and GB) practised using consultations not included in the analysis (five for treatment fidelity, 18 for motivational interviewing and 10 for therapeutic alliance) and discussed discrepancies. The raters independently rated consultations in batches of five and reconvened to discuss discrepancies. For motivational interviewing, a third rater (LN) independently rated six consultations and met with the raters to discuss discrepancies. For therapeutic alliance, a third rater (EG) independently rated three consultations and met with raters to discuss discrepancies and provide additional examples of ratings. Raters coded each consultation four times: once for treatment fidelity, twice for motivational interviewing (global ratings followed by behaviour counts) and once for therapeutic alliance.
Treatment fidelity analysis
Overall and specific agreement, for positive and negative agreement, were calculated for each item [35, 36]. Overall agreement was 0.82 (i.e. for 770/937 decisions, the raters agreed that the item had been done or not done). Items with low inter-rater reliability (defined as agreement in less than 70% of decisions) or with too many missing (due to issues with sound in the recording) were excluded. The items deleted were: (1) initial items, as advisors did not necessarily start the recording immediately, (2) items that could not be reliably recorded from audio-only recordings, e.g. ‘advisor shows acceptance of the participant’ (which could have been communicated non-verbally) or ‘showing the participant’s weight change on a graph’, (3) repeated items (e.g. ‘reviewing previously set goals or intentions’ appeared in two places in the session plan), and (4) items that could not be assessed without knowledge of the participant’s perspective (e.g. ‘uses analogies that are meaningful to the participant’).
The resulting checklists contained 31, 32 and 35 items respectively for the three sessions. In the final versions, the proportion of overall agreement was 0.90 (0.88, 0.90 and 0.93 respectively). The proportions of specific agreement were 0.88 for positive agreement and 0.92 for negative agreement.
Fidelity identified from the recordings
Overall, a mean of 41% of scheduled content was addressed, with session totals of 39, 35 and 49% respectively (Table 3). The amount of content addressed per participant ranged from 24 to 54% (SD 10%).
Content included most frequently was: taking weight and waist measurements (98%), setting date of next appointment (86%), reviewing general progress (85%), and reviewing weight change (84%). The most frequent items were ‘giving encouragement’ and ‘showing appreciation of participant’s efforts’ (95% in reviewing general progress and 88% in reviewing pedometer counts and physical activity).
Topics with lower or more variable frequency were: reviewing participant’s use of the previous session’s topic and handouts (8%), reviewing pedometer use, reviewing step counts and physical activity (excluding the item about appreciation of participant’s efforts) (19%), setting goals, developing action plans and assigning home activities (24%), and presenting the new topic, which varied from 21% for session 10 (Social Eating) to 79% for session 11 (Staying on Course).
Mean consultation length was 18.9 min (SD 7.6, range 9.0–30.4). Quantity of content correlated with consultation length (Spearman’s rho 0.73, p < 0.01).
For the global dimensions, using the categories described by Cicchetti  the intra-class correlation coefficients (two-way random, testing for consistency) were excellent for Direction, fair for Empathy, and poor for Evocation, Collaboration, Autonomy/Support and Spirit of Motivational Interviewing (Table 4).
For the behaviour counts, the intra-class correlation co-efficients showed excellent reliability for Giving Information, Simple Reflections, Complex Reflections and Motivational Interviewing Adherent, good reliability for Closed Questions, fair reliability for Open Questions and poor reliability for Motivational Interviewing Non-adherent.
Motivational interviewing identified from the recordings
The scale authors suggested that a mean score of 3.5 indicates ‘beginning proficiency’ and 4.0 indicates ‘competency’ for the global dimensions . The mean scores for Evocation, Collaboration, Autonomy/Support and Spirit of Motivational Interviewing fell below the threshold for ‘beginning proficiency’, and Empathy was at ‘beginning proficiency’ (Table 5). The mean score for Direction was high, indicating that advisors maintained focus on the target topic of weight loss.
Mean total questions asked by the advisors was 4.8 (SD 3.0) and mean total reflections was 5.9 (SD 4.5). Summary scores for the behaviour counts fell between the scale authors’ suggested scores for ‘beginning proficiency’ and ‘competency’ for Reflection to Question ratio and Percent Open Questions, and below the threshold for ‘beginning proficiency’ for Percent Complex Reflections and Percent MI-Adherent.
Inter-rater reliability and internal consistency
Excellent internal consistency was found (Cronbach’s alpha 0.92). Intra-class correlation coefficients (Table 6) showed excellent reliability for two items (warmth and empathy), good reliability for four items (involvement, rapport, client self-discloses thoughts and feelings, and client and therapist agree on the kind of changes to make), fair reliability for five items (supportive encouragement, client expresses emotions, client works actively with therapist’s comments, client and therapist share same sense about how to proceed, and client and therapist agree on salient themes), and poor reliability for the remaining three items.
Therapeutic alliance identified from the recordings
Mean total score was 4.1 (SD 0.8) indicating that the consultations were being rated around the mid-point, between the anchor points of ‘somewhat’ and ‘considerably’. Of the 11 items with fair to excellent reliability, items with a mean score above the mid-point were: supportive encouragement (mean 5.0, SD 1.3), involvement (mean 4.8, SD 1.1), warmth (mean 4.7, SD 1.2), client self-discloses thoughts and feelings (mean 4.5, SD 1.5), rapport (mean 4.4, SD 1.3) and empathy (mean 4.2, SD 1.3).
Relationship of process measures to weight outcome
Using independent t-tests to compare the 11 participants who had lost 5% or more of their baseline weight with the 11 participants who had not, there was no difference between the groups for: (i) consultation length, (ii) percentage of total content covered, (iii) motivational interviewing: Motivational Interviewing Spirit, percentage open questions, percentage complex reflections, percentage Motivational Interviewing Adherent, (iv) therapeutic alliance total score (Table 7).
Intervention fidelity should be improved by providing advisors with training, supervision and supporting materials . Nonetheless, observed adherence to intervention content was lower than expected. Paradoxically, having detailed session content may cause a conflict between achieving an intervention that can be consistently delivered and one that can be realistically delivered. The development of the fidelity measure revealed a relatively high number of items for the intended consultation length. However, advisors were not routinely using the full time allocation, with the average duration of the consultations being a third less than the time scheduled. This suggests that health advisors were selective in delivering content. Certain elements were performed consistently, such as reviewing general progress and taking weight and waist measurements, whilst others were performed inconsistently, such as reviewing participants’ use of information from the previous session and goal-setting. The findings indicated that advisors focused more on practical elements and education than on exploring participants’ perspectives. The latter is potentially more challenging, despite the availability of time and relationship continuity. Notwithstanding the detailed guide to content, differing levels of skill are required across intervention components. This may highlight a limitation of interventions designed to be delivered by trained advisors rather than by traditionally trained health professionals, in that elements of the intervention requiring more advanced psychological consultation techniques were not delivered, despite the availability of time.
The advisors knew they were being recorded, indeed, they switched on the recording equipment, as is common in UK primary care settings. During the five-month recording period, all consultations were recorded (whether or not at the mid-point of the intervention), to ‘normalise’ the routine of recording, of which a fifth (22/104) were analysed. The raters reported that the advisors appeared to have a ‘routine’ for the consultations and that the language used (for example, in beginning the consultation and initiating the ‘taking measurements’ task) indicated that this was a routine familiar to the participants. This suggests that the aim of capturing a well-developed relationship and consultation routine was achieved by recording at the intervention mid-point. Whilst it cannot be ruled out, there was no evidence to suggest that the advisors were behaving differently whilst being recorded.
Higher inter-rater reliabilities were achieved for ‘basic’ and specific skills in motivational interviewing (e.g. whether the advisor maintains a focus on the target topic, demonstrates an empathic approach, or asks closed questions). The authors of the scale noted that it performs better for rating ‘entry level’ than expert therapeutic behaviours, and specifically, for measuring empathy and micro-skills (such as using open and closed questions) rather than advanced skills (such as creating a discrepancy between client values and behaviours or eliciting change talk) . The findings of the present study are consistent with this. It is, however, easier to code a behaviour reliably when it is present, as behaviours which appear to meet the criteria can be scrutinised and any discrepancies between raters discussed.
The findings suggested that the advisors were operating at ‘entry level’ proficiency in motivational interviewing, which is consistent with the advisors’ level of experience and skill. Advisors consistently demonstrated an empathic approach and maintained a focus on the topic of weight loss. This concurs with the results about fidelity, which also found the advisors to be consistently encouraging and supportive. However, more advanced therapeutic skills in motivational interviewing were not observed. This ‘layering’ of skills in motivational interviewing, with increasing complexity requiring considerable experience and training, is consistent with other research .
In terms of therapeutic alliance, higher inter-rater reliability was achieved for affective qualities of the relationship (e.g. involvement, warmth, rapport and empathy) than specific skills (e.g. client works actively with therapist’s comments). Consistent with the findings from the other two measures, advisors demonstrated ‘entry level’ proficiency, achieving higher ratings for aspects of the quality of the interpersonal climate, such as supportive encouragement, involvement, warmth, rapport and empathy.
Overall, the findings demonstrated that certain aspects of the intervention were consistently delivered. Participants’ weight was checked, information was provided, and sessions maintained a focus on the target outcome. Furthermore, these tasks were conducted in the context of a warm and supportive advisor-participant relationship. Interviews with participants in the Camden Weight Loss trial reported elsewhere revealed that the most valued aspects of the intervention were the relationship they formed with the advisor, followed by regularity of meetings .
The aim of the trial was to examine the feasibility and effectiveness of a weight management programme which was centrally organised but locally delivered in a primary care setting. Other research examining consultations in primary care in which weight management is discussed has demonstrated the importance of training health professionals in weight management interventions . The results of the present study, however, highlight the importance of ongoing training and supervision. Multi-component weight management interventions comprise a spectrum of tasks and skills at varying levels of sophistication, which take time to acquire and develop.
An important determinant of intervention delivery is the congruence between the aims of the intervention and the experience and skill of the provider. One solution may be to use recorded consultations during supervision to provide feedback about fidelity and discuss strategies the advisor might use to achieve the intervention aims. In addition to providing ongoing training and supervision, another solution might be to alter the complexity of the intervention over time, as advisors’ experience and skill increase.
This study had several limitations. Consultation recordings were not available for all participants in the study, as they were gathered during a five-month period and participants varied in their start date for the 12-month intervention. Recordings were also subject to the vagaries of the primary care settings, including technical failure. The present sample attended a greater number of sessions compared to others in the intervention group, as those included necessarily continued to at least session 9, and were more likely to be male, although there is no clear explanation for this (there was no gender difference in the number of sessions completed). The small sample size made it difficult to assess the impact of variation in fidelity on intervention outcome (final weight change). Nonetheless, the observed consultations appeared to provide a representative picture of the intervention as delivered in practice.
The health advisors in the study were recruited and trained as recommended by the National Health Service Health Trainers Initiative . However, the study did not examine delivery of the intervention by other types of advisors, such as professionals trained in primary care or psychological interventions. Advisors with different backgrounds and experience may have delivered the intervention differently.
The results of randomised controlled trials and the effectiveness of complex interventions addressing behaviour change are dependent on the fidelity of the intervention delivered. Obesity statistics indicate that weight management interventions will continue to be required for the foreseeable future, emphasising the need for effective intervention delivery. This study has demonstrated that an independent process evaluation can identify the components of a complex intervention which are and are not reliably delivered. As these interventions are complex and layered, advisors delivering such interventions require considerable support, training and ongoing supervision to support those attempting to achieve significant weight loss.
Camden Weight Loss
intra-class correlation coefficient
National Health Service
National Institute for Health and Care Excellence
University College London
The LancetUrgently needed: a framework convention for obesity control. Lancet. 2011;378(9793):741.
World Health Organization. Global Health Observatory (GHO) data: Obesity; 2016 http://www.who.int/gho/ncd/risk_factors/obesity_text/en/#. Accessed 17 Jan 2017.
Health and Social Care Information Centre. Statistics on obesity, physical activity and diet, England; 2016. ISBN 978-1-78386-698-4.
Department of Health. Policy paper. 2010 to 2015 government policy: obesity and healthy eating; 2015. https://www.gov.uk/government/publications/2010-to-2015-government-policy-obesity-and-healthy-eating/2010-to-2015-government-policy-obesity-and-healthy-eating. Accessed 17 Jan 2017.
NICE National Institute for Health and Social Care Excellence. Weight management: lifestyle services for overweight or obese adults. NICE public health guidance 53; 2014. https://www.nice.org.uk/guidance/ph53. Accessed 17 Jan 2017.
Buckroyd J. Psychological interventions for people with a BMI ≥ 35. In: Obesity in the UK: a psychological perspective. Obesity Working Group, Professional Practice Board, The British Psychological Society; 2011. https://www1.bps.org.uk/system/files/Public%20files/Policy/obesity_in_the_uk_-_a_psychological_perspective.pdf. Accessed 17 Jan 2017.
Hartmann-Boyce J, Johns D, Aveyard P, Onakpoya I, Jebb S, Phillips D et al. Managing overweight and obese adults: update review. The clinical effectiveness of long-term weight management schemes for adults. Review 1a. University of Oxford; 2013a. https://www.nice.org.uk/guidance/ph53/evidence/evidence-review-1a-431707933. Accessed 17 Jan 2017.
Hartmann-Boyce J, Johns D, Aveyard P, Onakpoya I, Jebb SA, Phillips D et al. How components of behavioural weight management programmes affect weight change. Review 1b. University of Oxford; 2013b. https://www.nice.org.uk/guidance/ph53/evidence/evidence-review-1b-431707934. Accessed 17 Jan 2017.
Johns D, Hartmann-Boyce J, Aveyard P, Onakpoya I, Jebb S, Phillips D et al. Weight regain after behavioural weight management programmes. Review 1c. University of Oxford; 2013a. https://www.nice.org.uk/guidance/ph53/evidence/evidence-review-1c-431707935. Accessed 17 Jan 2017.
Johns D, Hartmann-Boyce J, Aveyard P, Lewis A, Jebb SA, Phillips D et al. Managing overweight and obese adults: evidence review. Review 2. University of Oxford; 2013b. https://www.nice.org.uk/guidance/ph53/evidence/evidence-review-2-431707936. Accessed 17 Jan 2017.
Marchant D. Exercise for obese individuals. In obesity in the UK: a psychological perspective. Obesity working group, professional practice board, the British psychological Society; 2011. https://www1.bps.org.uk/system/files/Public%20files/Policy/obesity_in_the_uk_-_a_psychological_perspective.pdf. Accessed 17 Jan 2017.
Sniehotta FF, Simpson SA, Greaves CJ. Weight loss maintenance: an agenda for health psychology. Br J Health Psychol. 2014;19(3):459–64.
Jeffery RW, Epstein LH, Wilson GT, Drewnowski A, Stunkard AJ, Wing RR. Long-term maintenance of weight loss: current status. Health Psychol. 2000;19(1S):5–16.
Miller W, Rollnick S. Motivational interviewing: preparing people for change. 2nd ed. New York: Guilford Press; 2002.
Burke BL, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol. 2003;71(5):843–61.
Armstrong MJ, Mottershead TA, Ronksley PE, Sigal RJ, Campbell TS, Hemmelgarn BR. Motivational interviewing to improve weight loss in overweight and/or obese patients: a systematic review and meta-analysis of randomized controlled trials. Obes Rev. 2011;12(9):709–23.
van Dorsten B. The use of motivational interviewing in weight loss. Current Diabetes Reports. 2007;7(5):386–90.
Cox ME, Yancy WS, Coffman CJ, Østbye T, Tulsky JA, Alexander SC, et al. Effects of counseling techniques on patients’ weight-related attitudes and behaviors in a primary care clinic. Patient Educ Couns. 2011;85(3):363–8.
Wampold BE. How important are the common factors in psychotherapy? An update. World Psychiatry. 2015;14(3):270–7.
Baldwin SA, Wampold BE, Imel ZE. Untangling the alliance-outcome correlation: exploring the relative importance of therapist and patient variability in the alliance. J Consult Clin Psychol. 2007;75(6):842–52.
Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23–45.
Sánchez V, Steckler A, Nitirat P, Hallfors D, Cho H, Brodish P. Fidelity of implementation in a treatment effectiveness trial of reconnecting youth. Health Educ Res. 2007;22(1):95–107.
Appel LJ, Clark JM, Yeh HC, Wang NY, Coughlin JW, Daumit G, et al. Comparative effectiveness of weight-loss interventions in clinical practice. N Engl J Med. 2011;365(21):1959–68.
van Eijk-Hustings YJ, Daemen L, Schaper NC, Vrijhoef HJ. Implementation of motivational interviewing in a diabetes care management initiative in the Netherlands. Patient Educ Couns. 2011;84(1):10–5.
Nanchahal K, Power T, Holdsworth E, Hession M, Sorhaindo A, Griffiths U, et al. A pragmatic randomised controlled trial in primary care of the Camden weight loss (CAMWEL) programme. BMJ Open. 2012;2(3):e000793.
Michie S, Rumsey N, Fussell A, Hardeman W, Johnston M, Newman S et al. Improving health: changing behaviour. NHS health trainer handbook. London: Department of Health Publications (Best Practice Guidance: Gateway Ref 9721); 2008. http://eprints.uwe.ac.uk/12057. Accessed 17 Jan 2017.
NICE National Institute for Health and Social Care Excellence. Obesity prevention. Clinical guideline CG43; 2006. https://www.nice.org.uk/Guidance/cg43. Accessed 17 Jan 2017.
Bandura A. Social foundations of thought and action: a social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
Locke EA. Latham GP. A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice-Hall; 1990.
Alemi F, Neuhauser D, Ardito S, Headrick L, Moore S, Hekelman F, et al. Continuous self-improvement: systems thinking in a personal context. Jt Comm J Quality and Patient Saf. 2000;26(2):74–86.
Moyers TB, Martin T, Manuel JK, Miller WR, Ernst D. Revised global scales: Motivational interviewing treatment integrity 3.1. 1 (MITI 3.1. 1). Unpublished manuscript, University of New Mexico, Albuquerque, NM; 2010. http://casaa.unm.edu/download/miti3_1.pdf. Accessed 17 Jan 2017.
Moyers TB, Martin T, Manuel JK, Hendrickson SM, Miller WR. Assessing competence in the use of motivational interviewing. J Subst Abus Treat. 2005;28(1):19–26.
Carels RA, Darby L, Cacciapaglia HM, Konrad K, Coit C, Harper J, et al. Using motivational interviewing as a supplement to obesity treatment: a stepped-care approach. Health Psychol. 2007;26(3):369–74.
Godfrey E, Chalder T, Ridsdale L, Seed P, Ogden J. Investigating the active ingredients of cognitive behaviour therapy and counselling for patients with chronic fatigue in primary care: developing a new process measure to assess treatment fidelity and predict outcome. Br J Clin Psychol. 2007;46(3):253–72.
Fleiss JL, Levin, Paik MC. The measure of inter-rater agreement. In: Fleiss JL, Levin B, Paik MC, Statistical methods for rates and proportions, New Jersey: John Wiley & Sons; 2013. p. 598–626.
Uebersax J. Raw agreement indices; 2014. http://www.john-uebersax.com/stat/raw.htm. Accessed 17 Jan 2017.
Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;(4):284–90.
Holdsworth E, Thorogood N, Sorhaindo A, Nanchahal K. A qualitative study of participant engagement with a weight loss intervention. Health Promot Pract. 2016;1524839916659847
Landers R. Computing intra-class correlations as estimates of inter-rater reliability in SPSS. The Winnower, 2015;3:e143518.81744. https://thewinnower.com/papers/1113-computing-intraclass-correlations-icc-as-estimates-of-interrater-reliability-in-spss. Accessed 17 Jan 2017.
Camden Primary Care Trust (NHS Camden) funded the intervention from which the data were gathered. The funding source had no role in the design or conduct of the study; collection, management, analysis or interpretation of the data and preparation, review or approval of the manuscript.
Availability of data and materials
The data used during the current study are not publicly available as they consist of audio- and video-recordings of consultations during an intervention from which individual health advisors and/or volunteers receiving the weight loss intervention might be identifiable. Confidentiality of the data was stipulated in the study protocol, as approved by the local research ethics committee.
Ethics approval and consent to participate
The project was approved by the London School of Hygiene and Tropical Medicine Observational/Interventions Research Ethics Committee, reference number 6356. Written consent was obtained from all participants.
Consent for publication
The authors declare they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Noble, L., Godfrey, E., Al-Baba, L. et al. Treatment fidelity in the Camden Weight Loss (CAMWEL) intervention assessed from recordings of advisor-participant consultations. BMC Obes 5, 24 (2018). https://doi.org/10.1186/s40608-018-0203-7