Bosanquet DC,1 Nandhra S,2 Wong KHF3, Long J,4 Chetter I,4 Hinchliffe RJ5 on behalf of The Vascular Society of Great Britain and Ireland Amputation Special Interest Group James Lind Alliance Priority Setting Partnership
Why we undertook the work: Research is costly to the NHS and takes lots of time. It is therefore vital to make sure any research done is on topics which are important to patients, carers and clinicians. The ‘James Lind Alliance’ group have developed a process for asking patients and clinicians what topics are important to them within a given area of research. This paper presents the results of this process for the topic ‘amputation surgery’ (of the leg).
What we did: First, we asked individual patients and clinicians to list important areas of amputation surgery worthy of further research. We joined these two lists and removed any duplicates. We then held a remote meeting of patients, carers and all different types of healthcare professionals, facilitated by experts from the James Lind Alliance. The group discussed the proposed research topics and prioritised them into an ordered list which reflected their overall importance.
What we found: A total of 481 clinicians, and 373 patients or carers proposed research questions about vascular surgery in general, which were amalgamated into a list of 12 questions specifically about amputation surgery. These were discussed at the remote meeting and ordered in terms of their importance. The top 10 questions, which are given in full in this paper, related to: preventing amputation, supporting recovery after amputation, improving outcomes after amputation (such as preventing or treating pain, or helping wounds heal well) and giving people undergoing surgery the right information.
What this means: Research, which is important to both patients and healthcare professionals, can now be undertaken within these topics.
Introduction: Major lower limb amputation (MLLA) is a life-changing event often associated with high mortality and morbidity rates. Research into MLLA surgery is limited. The Vascular Society of Great Britain and Ireland (VSGBI) in partnership with the James Lind Alliance (JLA) aimed to identify and develop key research priorities for MLLA.
Methods: A modified JLA Priority Setting Partnership was undertaken, encompassing all vascular practice. Two separate Delphi processes to identify research priorities were undertaken with healthcare professionals, patients and carers, led by the VSGBI. The priorities were then scored by the same participants and amalgamated to produce a list for final ranking. The final consensus meeting was attended by patients, carers and healthcare professionals from a variety of backgrounds involved in the care of people with MLLA. Using a nominal group technique, a ranked list of the top ten research priorities were identified.
Results: A total of 481 clinicians submitted 1,231 research priorities relating to vascular surgery in general. Sixty-three MLLA-specific research priorities were combined into five final priorities. Three hundred and seventy-three patients or carers submitted 582 research priorities related to vascular surgery in general. Nine MLLA-specific research priorities were identified after combining similar priorities. The final consensus meeting produced a ranked top 10 list of research priorities relating to: MLLA prevention, supporting rehabilitation, improving clinical outcomes following MLLA (preventing/treating pain including phantom limb pain and improving wound healing) and research into information provision for patients undergoing MLLA.
Conclusions: The top 10 MLLA research priorities provide guidance for researchers, clinicians and funders on the direction of future research questions that are important to both healthcare professionals and patients.
Over 4,000 major lower limb amputations (MLLA) are performed per annum in the UK1 for end-stage lower limb arterial disease or profound foot sepsis. Amputation is a significant life event for patients and their carers/families. Although supported by recommendations for optimal practice,2 MLLA can be associated with high mortality and complication rates.3,4 The process of a patient undergoing MLLA is a multi-faceted healthcare challenge, dependent on the complex integration of pre-operative assessment, peri-operative care techniques and postoperative rehabilitation.
Within these care pathways, there are invariably numerous opportunities for interventions to improve clinical and patient-reported outcomes. At present, there is a paucity of high-quality research into MLLA care; for instance, the Cochrane vascular database of 177 systematic reviews contains only two on a topic pertinent to MLLA.5,6 It is therefore imperative to understand where impactful research, valued by both patients and the healthcare professionals, should be focused, which can inform research funders, health commissioners and policy makers. Arguably, to develop research priorities which are generalisable and of broad value, they should be relevant to the patient and clinician and avoid wasted research efforts.7 One validated approach is the James Lind Alliance (JLA) Priority Setting Partnership (PSP). This is a collaborative method of discerning key research questions of multi-disciplinary healthcare professionals and patients/carers with lived experience of the condition.8 The Vascular Society of Great Britain and Ireland (VSGBI) has worked to define the priorities for vascular research in general from a healthcare professional perspective.9 This initiative led to the development of nine focused special interest groups (SIGs), one of which is Amputation Surgery. The Amputation Surgery SIG comprises a multi-disciplinary team of clinicians and patients/carers with an interest in furthering research activity in the field of amputation surgery. The aim of this exercise was to create a hierarchical list of important clinical research questions in the field of amputation surgery, using the modified JLA PSP, to guide future investigative endeavours.
A modified version of the JLA PSP methodology8 was used to address vascular surgery research priorities in their entirety. The process began with a clinician-led priority setting process, followed by a similar patient-led process. Amputation surgery specific research questions were identified from both processes, duplicates removed and unclear language resolved, before a final priority setting workshop. The Vascular Condition PSP process is summarised in Figure 1.
Throughout the PSP, the intention was to follow the JLA process as closely as possible. However, initial resource limitation meant that the first survey, gathering research priorities, had to be confined to the clinical community only. The survey gathering questions from patients and supporters followed two years later, when resources permitted. The two sets of questions were analysed, summarised and ranked separately by their respective communities.
Setting up the Vascular Condition PSP
The Vascular Research Collaborative (VRC) was founded in 2016 and the Vascular Condition PSP was subsequently established in April 2019.10 Both were funded by the VSGBI, aiming to develop a national strategy for vascular research and identify research priorities in sub-specialty areas within vascular surgery. The initial outcomes and processes have been published.9
Scope of the Amputation Surgery SIG
The Amputation Surgery SIG PSP team comprised two clinical leads (RJH and DB), two surgeons in training (SN and KW), a JLA adviser (TG), one PSP information scientist (JL), one SIG coordinator (BC) and a patient representative (DC), who has bilateral MLLA with experience of amputation research.
The remit of the Amputation Surgery SIG is to support research into the process of a minor or MLLA in adults (18 years or older), including pre-, peri-, and post-operative care, and to develop the top 10 research priorities in amputation surgery. For the purpose of the PSP, MLLA was defined as surgical removal of the lower limb above the ankle. Minor amputation was defined as surgical removal of a toe(s) and/or part of the foot. The SIG considered amputations due to peripheral arterial disease, non-healing wounds and/or diabetes related complications within its remit.
Clinician-led priority setting process
A clinician-led PSP process was completed in 2018,9 which identified nine key areas from 45 potential topics using a modified Delphi approach with two rounds of online surveys involving the membership of the VSGBI, Society of Vascular Nurses (SVN), Society for Vascular Technology (SVT) and the Rouleaux Club (vascular surgical trainees). The first round invited any suggestions for research priorities in the broad scope of ‘vascular surgery’, which were then collated and categorised into pathological topics and research categories by the steering group. Priorities relating to the same fundamental issue were amalgamated into a single priority. The priorities were recirculated in the second round to the same participants for scoring according to importance. These results have been published9 and are presented here briefly.
Patient/carer-led research question identification process
The Vascular Condition PSP carried out a consultation to gather potential research priorities from vascular patients and carers for approximately six months (27 August 2019 to 17 March 2020) via online surveys, paper surveys in outpatient clinics and focus groups. SIG members, UK vascular units (as listed on the National Vascular Registry), charities and patient groups were contacted and asked to distribute (physically and electronically) a survey designed to gather potential research priorities in vascular surgery. The affiliated healthcare organisations listed above, the British Society of Interventional Radiology (BSIR) and the British Association of Chartered Physiotherapists in Amputee Rehabilitation (BACPAR) were also asked to circulate the survey. Amputation-specific research priorities were identified and similar or duplicate questions merged. Generic priorities relating to the overall provision of vascular services (which may have included services related to amputation surgery) were considered outside the remit of the Amputation Surgery SIG and reviewed by the ‘Service’ SIG. Priorities were edited by the SIG chairs, with input from the SIG patient representative, to produce a list of easily understood research priorities with no overlap and minimal uncertainty. These minor edits were subsequently ratified by the rest of the SIG team.
Interim patient/carer-led research question prioritisation process
Summarised research priorities were redistributed for scoring. Priorities from each of the SIGs were presented for completion at this point. Patients and carers with experience of amputation(s) were asked to score the priorities according to importance. This process was undertaken from 5 November 2020 to 27 January 2021. In order for results to be reviewed in time for the final prioritisation workshop, scoring of amputation-related questions was stopped on 9 December 2020.
Final prioritisation workshop
Prior to the prioritisation workshop, the SIG team combined interim patient scored priorities with priorities from the clinician PSP survey and duplicates were merged. The patient representative was involved in this process and the end-result was again ratified by the Amputation Surgery SIG.
The final prioritisation process was conducted via a virtual online meeting on 25 January 2021. Patient/carer attendees were recruited via direct contact and if they expressed interest in supporting the prioritisation workshop during the research priority identification and scoring process. Healthcare workers were recruited via direct communication with national bodies (e.g. BACPAR and The Royal College of Occupational Therapy Specialist Section Trauma and Musculoskeletal Health; Prosthetic Amputee Forum; RCOTSST&MSH PAR) and via direct links with members of the SIG team.
The workshop was led by three advisers skilled in the JLA process. Members of the Amputation Surgery SIG provided general support, but had no influence over the process of priority setting. A nominal group technique was used to define the final, ranked top 10 research priorities. Workshop attendees were asked to review the final research priorities prior to attending the workshop and rank them in order of importance. After an overview of the JLA process, attendees were divided into three ‘breakout’ groups, each comprising an equal mix of patients, carers and healthcare professionals. The ranking in order of importance of research priorities was discussed three times. In the first breakout group, each participant presented their ‘top three’ and ‘bottom three’ of the shortlisted priorities. In the second round, the same groups discussed how to pool these individual rankings into a single priority listing (numbered 1-12). The priority listings from the three groups were collated to generate an interim ranking of the research priorities. Finally, the attendees were allocated to different groups for a third round of breakout discussion, to discuss the finer details of the order of the interim ranking. The results of each group’s rankings were again collated and summated, creating a final list. The final, ranked list of top 10 research priorities was presented to participants in a final session to facilitate discussion of overall acceptability. Members of the SIG PSP team observed all sessions (muted with cameras off) and noted key points arising from the discussion.
Results from the clinician-led research priority identification and prioritisation
Some 481 healthcare professionals involved in the care of vascular patients engaged with the Vascular Condition PSP, suggesting a total of 1,231 research priorities.9 Sixty-three amputation specific research priorities were reported. After combining similar research priorities, a final list of five important amputation research priorities was identified and redistributed to clinicians for scoring regarding importance. Priorities were ranked according to clinicians’ scores. The resulting clinicians’ research priorities ordered by importance, using mean score, are given in Table 1.
Patient/carer-led research question identification and prioritisation
Three hundred and seventy-three vascular patients/carers suggested a total of 582 research priorities, relating to vascular surgery in general. Fourteen were specific to amputation surgery. After combining overlapping priorities, a total of nine research priorities were confirmed and redistributed to patients/carers for scoring regarding importance. Thirty-six patients/carers engaged with the scoring process. The resulting patient research priorities, ordered by importance using mean score, are given in Table 2.
Final prioritisation workshop
Prior to the workshop, the Amputation Surgery SIG team pooled clinician and patient/carer research priorities, resulting in a final list of 12 priorities, detailed in Table 3. In order to reduce risk of bias, these priorities were randomly ordered and each assigned a letter (rather than a number).
The final prioritisation workshop was attended by 10 patients/ carers and 12 healthcare professionals, with an additional eight observers. The prioritisation process resulted in a final, ranked, top 10 research priority list (Table 4). The priorities are ordered according to importance as determined by the workshop. The last three priorities all scored the same and are therefore ranked equal. There was general consensus amongst the participants that the list accurately and comprehensively reflected well the discussions and viewpoints which occurred in the breakout groups.
A number of key points were noted during the discussion. There was clearly a difference between participants who thought amputation prevention was paramount (priorities 1, 6 and 8a) and those who felt improving outcomes following amputation was paramount (priorities 2, 3, 4, 5, 7, 8b and 8c). Many participants individually remarked that there was significant overlap between research priorities. For example, priorities 1, 6, and 8a all pertained to amputation rate reduction. It was also noted that priority 3 (improving clinical outcomes following amputation) could encompass some of the other research priorities, such as improving healing (priority 7) and pain (priority 4) outcomes. Priority 2 (What are the best ways to support rehabilitation following amputation?) could encompass priority 8b (How do we optimise prosthetic limb use following amputation?) and priority 12 (What are the best mobility aids following amputation?).
The two research priorities which did not make the top 10 were priority number 11 (“Is through- or above-knee amputation better?”) and 12 (“What are the best mobility aids following amputation?”). It was noted that the low ranking of priority 11 (through-knee versus above-knee amputation) may have been influenced by through-knee amputations being less commonly performed in the UK. Furthermore, there were no patients with a through-knee amputation in the workshop. Participants expressed that the lack of awareness and experience within this cohort (particularly from the patient representatives present) could have led to a perceived lower importance of this research question.
Using modified JLA methodology, we identified key research priorities in amputation surgery. A two-round Delphi process covering all aspects of vascular surgery care identified five amputation research priorities from clinicians, which were pooled with priorities raised by patients and carers to produce 12 priorities for final ranking according to importance. Following discussion with patients, carers and healthcare professionals, a final, ranked, top 10 list of clinical research priorities in amputation was produced by consensus.
Strengths and limitations
The strengths of this study include the use of a well-established systematic and transparent process to identify research priorities of patients and healthcare professionals across the UK, under supervision from a steering group and experienced JLA advisors. The priority setting process included a variety of stakeholders, to provide a broad view of unanswered questions. Facilitation by JLA advisors ensured that all parties contributed actively to discussion.
There are several limitations to consider in this PSP. Firstly, due to the survey-based nature of the process, there is a potential for responder bias for both clinicians and patients, which may not be representative of all patients with amputations and healthcare professionals involved in their care. We attempted to include patients from a wide range of geographical, socio-economic and health literacy backgrounds, as well as healthcare professionals who may interact with patients differently (carers, nurses, doctors, AHPs). However, not all were available for the final prioritisation process. In particular, there is potential bias involved when considering the research question of comparing through-knee versus above knee amputations: the lack of awareness, experience and representation in this cohort may have impacted on the perceived relative importance of this topic.
The PSP was conducted using a modified approach to conventional JLA priority setting methodology, to capture the broad scope of questions in vascular care. The key modification was the disconnect between the patients and healthcare professional research priority identification and scoring process, which were only pooled later. Typically both groups undertake a single identification and scoring process. Due to the inherent subjective process of PSP, prioritisation may have been biased by initial survey approaches. It is not possible to assess whether the top 10 research priorities may have differed, had all questions been analysed, summarised and scored by all participants. However, it is clear that the chosen top 10 priorities included those of specific importance to patients/carers, to clinicians and to both groups. Finally, the overlap in research priorities occasionally made the ranking process more difficult; often participants grouped certain priorities together or ranked them higher if they encompassed parts of other topics. Research priorities identified as missing at the final prioritisation workshop included psychological well being and support. These priorities do feature in the Service SIG however, encompassing priorities spanning the entire scope of vascular surgery. It was also noted by participants that there was no podiatry representation, recognised as an important stakeholder group.
Implications for future research
Defining a specific top 10 research priorities provides an invaluable starting point for future research in amputation surgery. The top 10 research priorities will guide researchers and funders to the most important research questions for both healthcare professionals and patients. Specific research strategy will be decided upon by further evaluation of individual research questions. Amputation surgery research in the United Kingdom and the wider global amputation community is likely to be guided by this work for many years to come. It is important to recognise that all priorities discussed were considered of value: priorities 11 and 12 remain important areas for future research. It is expected the Amputation Surgery SIG will select individual research priorities, with the aim of specifically developing ongoing research strategy. The overall aim of the Amputation Surgery SIG is to develop a national research group for amputation surgery, with patients, carers and amputation experts from around the country, supported by national bodies such as the VSGBI and the Vascular and Endovascular Research Network (VERN).
November 24, 2021
1.Royal Gwent Hospital, South East Wales Vascular Network, Newport, UK
2.Population Health Sciences Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
3.Southmead Hospital, North Bristol Trust, Southmead Road, Bristol, UK
4.Hull York Medical School, University Road, Heslington, York, UK
5.University of Bristol Medical School, Bristol, UK