Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Sep 22.
Published in final edited form as: Psychiatry Res. 2022 May 11;313:114612. doi: 10.1016/j.psychres.2022.114612

Jumping through the hoops: Barriers and other ethical concerns regarding the use of psychiatric electroceutical interventions

LY Cabrera a,*, M Gilbert b, E Achtyes c,d, AM McCright e, R Bluhm f
PMCID: PMC10516532  NIHMSID: NIHMS1928204  PMID: 35584563

1. Introduction

At multiple points along the care continuum, mental health providers, patients, and caregivers encounter barriers to providing or receiving timely and effective care for major depressive disorder (MDD). Barriers exist on multiple levels, and often times there are multiple barriers in play. One group of interventions for MDD that may face heightened barriers are psychiatric electroceutical interventions (PEIs), interventions that use electrical or magnetic neurostimulation or neuromodulation to alter brain circuitry and function with the goal of treating neuropsychiatric conditions. Electroconvulsive therapy (ECT) and transcranial magnetic stimulation (TMS), for example, are approved by the U.S. Food and Drug Administration (FDA) for MDD, while deep brain stimulation (DBS) remains investigational for individuals with severe TRD.

1.1. Structural barriers

Structural barriers are bureaucratic, economic, or infrastructural factors associated with health services, including availability of services and providers, administrative challenges, limited resources, cost of therapy, and referral patterns by psychiatrists and other clinicians that affect patients’ access to a therapy (Tomczyk et al., 2020). A key structural barrier to medical treatments in general, and mental health care in particular, is access to therapies (HealthMental Health America, 2016). Financial costs and insufficient insurance coverage are other dimensions of access barriers in mental health care (Rowan et al., 2013). Access issues are exacerbated by inconvenience, or inability of patients to obtain an appointment (Mojtabai et al., 2010), transportation limitations, space limitations reducing the numbers of people treated (Mechanic, 2002, Wilkinson et al., 2021), as well as the necessity to be released from work for treatment, and arranging childcare.

A barrier specific to PEIs is the fact that medical education does not include sufficient focus on PEIs (Goldbloom and Gratzer, 2019). The lack of clarity in PEI clinical guidelines (APA, 2001; McClintock et al., 2018; Perera et al. 2016), including who is an optimal patient and when to start PEI treatment, is another structural barrier (Cormier et al., 2019). Related to this is the infrequent use of clinical practice guidelines by providers for clinical decision-making (Cabana et al., 1999; HealthMental Health America, 2016), which can also deter the expedient use of evidence-based practices. Moreover, in the specific case of PEIs, current guidelines for ECT (APA, 2001) and TMS (McClintock et al., 2018; Perera et al. 2016) are outdated.

A final major structural barrier is the lack of a federal legal framework providing guidance on PEI procedures, including who can receive these interventions and who is qualified to prescribe or perform the procedures (Livingston et al., 2017).

1.2. Attitudinal barriers

Attitudinal barriers include beliefs, attitudes, and emotions that inhibit help-seeking and treatment (Tomczyk et al., 2020). These include stigma (Mojtabai et al., 2010; Mental Health America, 2016), negative beliefs or fear of treatment (e.g., concerns about memory loss), and misinterpretations or uncertainty about treatment consequences (Andrade et al., 2013).

For example, while stigma is a common barrier to the use and public acceptance of mental health treatments, this is exacerbated in the case of some PEIs, in particular given the negative image of ECT among the general public (Lauber et al., 2005; Wilkinson et al., 2021). In the case of PEIs involving neurosurgery, such as DBS, views towards them might be influenced by a history of transgressions and complications related to the use of older ablative procedures performed in the mid-1900s. Resistance from psychiatrists and other clinicians to referring patients is another attitudinal barrier (Tomczyk et al., 2020). As such, there are mixed perceptions among both clinicians and the general public (Cormier et al., 2019; Cabrera et al., 2018a).

1.3. Other ethical issues

Beyond structural and attitudinal barriers, the neuroethics literature has identified other important ethical issues when discussing PEIs. Many of the ethical concerns identified in the neuroethical literature for PEIs are also relevant for medications as they are for PEIs, including concerns about their effectiveness (Cabrera et al., 2019; 2018b), the balance between benefits and risks, informed consent (Bell et al., 2014; Fins 2009; Blease 2013; Rossi et al., 2009), and effects of these interventions on personal identity (Baylis, 2013; Jotterand and Giordano, 2011; Lipsman and Glannon, 2013), personality (de Haan et al., 2017; Synofzik and Schlaepfer, 2008), agency (Glannon, 2014; Goering, 2014), autonomy (Goering, 2015, 2017), and authenticity (Johansson et al., 2011; Kraemer, 2011). However, the similar list of issues raised for PEIs and for pharmaceutical treatments does not mean that stakeholders perceive a specific issue to be equally important for both kinds of therapies. Moreover, the fact that PEIs are considered for treatment resistant depression (TRD)—a form of depression that does not improve despite the use of multiple and appropriately dosed antidepressant medications, and that we know less about their mechanisms of action, do make some of these issues more salient or bring different considerations into play.

A better understanding of the barriers to, and other ethical concerns about, PEIs is important for planning mental health services, setting resource allocation priorities, reducing the burden of mental illness (Andrade et al., 2013) and addressing misconceptions. However, little research has examined stakeholders’ views about barriers and other ethical considerations around these interventions, and the few that exist are mostly on ECT and are focused only on one stakeholder group. This study aims to provide insights into this important question with a focus on electroceuticals for TRD among three different stakeholder groups—psychiatrists, persons diagnosed with depression, and members of the general public.

2. Methods

We conducted semi-structured interviews with 16 practicing psychiatrists, 16 adult patients diagnosed with depression, and 16 adults in the general public with no diagnosed psychiatric disorder in Michigan. We included members of the general public, as public sentiment (in the form of enthusiasm, fear, stigma, acceptance, etc.) helps to define the general milieu in which physicians, caregivers, and patients act. Semi-structured interviews are ideal for eliciting in-depth, meaningful information from subjects (Hsieh and Shannon, 2005). In our analysis, we focused on these groups’ perceived barriers and other ethical concerns about ECT, TMS, and DBS. The Michigan State University Institutional Review Board approved this project as an exempt study (STUDY00001247), which required no written consent from participants.

2.1. Recruitment

We recruited practicing psychiatrists who had at least some experience with and/or interest in neuromodulation techniques. We emailed potential participants recommended by a member of the research team with an invitation to participate in the study. If we received no response within two weeks, we sent a reminder email, after which we made no further contact. When selecting psychiatrists to interview, we aimed for a sample of at least 20% females, at least one non-white participant, and a range of clinical experience with PEIs, with at least one psychiatrist with substantial or moderate experience with either ECT, TMS, or DBS. We recruited potential patients diagnosed with depression via flyers in mental health clinics primarily, but we also advertised via local establishments (e.g., coffeeshops and libraries), and social media posts. We recruited members of the public via local establishments (e.g., coffeeshops and libraries), and social media posts. We pre-screened participants, asking them if they had ever been diagnosed with depression, to ensure we included them in the correct group.We followed up by email or phone with those individuals who indicated interest in the study. For our patient and public samples, we aimed for a balance of males and females, and race and ethnicity, and we aimed to have at least five patients with moderate experience with a PEI, and five members of the public with caregiving experience. Table 1 provides selected demographic characteristics of the three groups. For details on participant’s experience or knowledge level with PEIs please see the supplemental material.

Table 1.

Demographic Characteristics of the Three Stakeholder Group Sub-Samples

Psychiatrists (n=16) Depressed Patients (n=16) General Public (n=16)
n (%) n (%) n (%)
Gender
 Male 11 (68.8%) 6 (37.5%) 7 (43.8%)
 Female 5 (31.3%) 10 (62.5%) 9 (56.3%)
Age
 Median 54 48.5 40
 Range 34–66 18–65 20–81
Race/Ethnicity
 White (not Hispanic) 14 (87.5%) 12 (75%) 9 (56.3%)
  Hispanic 0 (0.0%) 1 (6.25%) 5 (31.3%)
 Non-white 2 (12.5%) 3 (18.8%) 2 (12.5%)
Education
 High school degree 3 (18.8%) 1 (6.3%)
 Some college 2 (12.5%) 3 (18.8%)
 Bachelor’s degree 5 (31.3%) 8 (50.0%)
 Master’s degree 5 (31.3%) 3 (18.8%)
 Doctoral degree 1 (6.3%) 1 (6.3%)

2.2. Procedures

When scheduling interviews, we sent participants a consent letter containing key details about the study and a brief fact sheet summarizing the PEIs (see supporting information S1 document). Prior to each interview, we invited participants to ask any questions they had about our study before securing their oral consent to participate.

We created our interview guides using insights from relevant prior studies and feedback from our project’s Scientific Advisory Board. The interviews took place over a period of four months from February to May 2019. Semi-structured interviews took place in person, via Zoom, or by telephone. We started the interviews with general questions about the participants’ demographic information, background, and experience. We also asked patients and members of the public to describe the PEIs to us to help ensure that they understood the therapies being discussed. The remainder of the interview guides share the same core questions; each participant was asked about either one or two PEIs (depending on time limits), selected based on the participant’s experience and interest, while also keeping a balance across the PEIs in the study. The interviews ranged from 30 to more than 60 minutes. Participants were compensated for their time completing the interviews.

While these interviews covered a range of PEI topics, we focus this paper on perceptions of barriers to and other ethical concerns about using PEIs (See supporting information S2 Document). All interviews were recorded, anonymized, and transcribed verbatim for analysis.

2.3. Data analysis

We analyzed our data employing a qualitative content analysis approach (Hsieh and Shannon, 2005; Sandelowski, 2000), using the web-based software Dedoose. We developed a codebook with a priori codes based on key insights from the relevant neuroethics literature, then added new codes emerging from a few interview transcripts. We identified any necessary adjustments to the codebook, using the method of ‘constant comparison’ to structure the coding framework—comparing emerging codes with established codes merging similar ones together. Finally, we developed broader categories with codes being merged together to begin the process of identifying themes or emerging concepts.

Two team members (MC and EC) coded the remaining interviews with the finalized codebook, and another two (LC and RB) served as secondary coders. We used ‘interpretive convergence’ for code validation, with intensive group discussion of codes until consensus was achieved (Saldana, 2008) in cases of disagreement. We kept a research log during data analysis to enhance rigor and encourage transparency of research decisions within the process and reflection during analysis.

While barriers are an ethical issue, we decided to separate other ethical issues from structural and attitudinal barriers (Table 2).

Table 2.

Most Frequently Mentioned Barriers and Other Ethical Concerns

Themes and Sub-Themes Psychiatrists (n=16) Depressed Patients (n=16) General Public (n=16) Total (n=48)
Perceived Structural & Attitudinal Barriers
Access limitations 93.8% 93.8% 87.5% 91.7%
 Limited availability of PEI clinics & providers 75.0% 81.3% 25.0% 60.4%
 Lack of insurance coverage 68.8% 87.5% 56.3% 79.2%
 High overall cost 50.0% 81.3% 56.3% 62.5%
Low mental health literacy 75.0% 75.0% 68.8% 72.9%
 Perceived stigma 68.8% 56.3% 50.0% 58.4%
 Insufficient knowledge about interventions 50.0% 37.5% 25.0% 37.5%
Time constraints 68.8% 50.0% 12.5% 43.8%
Caregiver support limitations 43.8% 12.5% 6.3% 20.8%
Other Ethical Concerns
Issues related to informed consent 56.3% 81.3% 56.3% 64.6%
Lack of safety from side effects and unknown (long-term) risks 62.5% 43.8% 43.8% 50.0%
Limited efficacy 62.5% 31.3% 31.3% 41.7%
Social justice 43.8% 43.8% 18.8% 35.5%

We include selected interview excerpts to illustrate key themes and sub-themes. For readability, we have removed any non-content utterances.

3. Results

3.1. Barriers

The most common barrier across all groups was access limitations, followed by perceived low mental health literacy. Time constraints was also a commonly mentioned barrier, but the presence of this theme varied considerably across the stakeholder groups, with psychiatrists more frequently reporting this as a barrier than members of the public. Similarly, compared to other stakeholder groups, psychiatrists more frequently identified concerns about the limitations for caregiver support.

3.1.1. Access limitations

Three sub-themes were associated with access limitations. One was the limited availability of (a) clinics offering PEIs and (b) providers with the expertise to refer or offer these interventions. Considerably more psychiatrists and patients mentioned this subtheme than did the public.

“DBS is going to be available in very few places, … so you’re going to be restricted to having …to live in one of the relatively small number of cities which have access to a DBS program and so I think that access issue is a major barrier.” (Psychiatrist 10)

“I was having a hard time finding a psychiatrist up here ... There is a real lack of psychiatrists.” (Patient 2)

“I think there’s not enough access, there’s not enough money, there’s not enough psychiatrists, and there’s not enough surgeons who are willing to do psychiatric surgery.” (Public 7)

Lack of insurance coverage,was another access limitation mentioned by the majority of subjects in each stakeholder groups. Psychiatrists were more likely to mention insurance coverage when discussing TMS rather than ECT, whereas patients and the public raised concerns about insurance more broadly across all interventions.

“… Most insurances don’t seem to cover [TMS]. And patients have to pay out of pocket.” (Psychiatrist 1)

“I feel like insurance and insurers wouldn’t want to cover that, especially like they’d want you to try out every single treatment first. So that could definitely be a barrier … It’s a year to get there because you have to jump through hoops.” (Public 1)

“I mean [DBS] seems like that’s going to be a serious procedure that’s going to require that somebody has high amounts of healthcare insurance. [I]t’s going to be pretty limited being able to access those particular treatments.” (Public 4)

Overall cost was a third sub-theme of access limitations mentioned by the majority of subjects in each group. While participants acknowledged that cost concerns would be especially relevant for DBS (which includes neurosurgery, anesthesia, and the implantable device itself), they nevertheless mentioned them across all PEIs.

“[C]ost is a big one. [T]he cost is not just for implantation [of DBS] but the cost is also for maintenance of patients.” (Psychiatrist 12)

“For me, the biggest concern or issue has been cost…I have usually been pretty easily able to get in to a therapist, but these types of treatments, there usually has to be referrals and, waits and costs.” (Patient 6)

“You have to have the financial means. So therefore, more than 50% of the population wouldn’t be able to use ECT, or TMS, or any of the others.” (Public 8)

3.1.2. Low mental health literacy

Low mental health literacy was also a perceived barrier to the use of PEIs, in particular raising issues of perceived stigma and poor understanding of the interventions.

A majority of subjects in each stakeholder group raised a concern about perceived social stigma associated with these types of interventions, especially ECT. They often mentioned negative portrayals of ECT in the media and popular culture, which have created misconceptions about the treatment.

“I think the stigma is coming from a misconception about the treatment, and a social perspective on psychiatry that hopefully has at least partially gone away.” (Psychiatry 13)

“[N]obody thinks it’s cool to have ECT done. ….. because of what they had in movies, you know, The One Who Flew Over the Cuckoo’s Nest, how it used to be back in the ‘50s…. [T]hat has all dragged along with ECT and that’s a stigma.” (Patient 13)

“I think ECT probably more than any other psychiatric or even neurologic procedure has a cultural stigma attached to it.” (Public 07)

In addition to stigma associated with the interventions used, participants from all stakeholder groups also noted that mental illness itself is stigmatized, influencing patients’ treatment-seeking behavior and exacerbating patient’s limited access to mental healthcare.

“[T]his always links back to the fact that we still have the stigma associated with mental illness.” (Psychiatrist 3)

“Mental health care isn’t as easily accessible as it should be, which I believe is a huge part of the stigma because if it were more well-accepted … then it would be a lot easier to access healthcare for that.” (Patient 11)

“Our society needs to change its perceptions of how we view mental health, how we embrace it.” (Public 5)

The second sub-theme within the broader concern about low mental health literacy was the perceived lack knowledge —or even lack of awareness — of PEIs.

“The biggest barrier continues to be the public knowledge and public perception.” (Psychiatrist 3)

“ [T]here’s so many people not aware of it, or they don’t want to be aware of it actually.” (Patient 2)

“Right now, I would imagine even a lot of psychiatry patients don’t know that they even have the ability to gain access to these treatments.” (Public 7)

3.1.3. Barriers specific to certain PEIs

The last two themes, while robust, nevertheless were mentioned less frequently in all three groups, and each was associated with a particular PEI. A majority of psychiatrists and patients mentioned that time commitment was a barrier to the more widespread use of TMS, an intervention that requires several sessions a week.

“People cannot spend the time because it’s travel time, and some people’s lives are so busy that they [cannot] do it five days a week, in addition to all of the things that they do.” (Psychiatrist 6)

“Having to make multiple trips to a doctor’s office on an ongoing basis, that would probably be a pretty big barrier for a lot of people. You know, they would not be willing to do it. They might not be able to do it.” (Patient 10)

Finally, psychiatrists noted the heightened demands for caregiver support when discussing ECT, as the use of general anesthesia for the procedure requires having someone to transport and escort the patient.

“[T]here is a significant travel burden …. it’s a burden for them personally but also for someone to escort them and transport them home.” (Psychiatrists 8)

“I think that’s a barrier for people, to have the emotional support you need. And the kind of support you need, a driver to take you there, and all that kind of stuff.” (Patient 12)

3.2. Other ethical concerns

The most common theme for other ethical concerns within the entire sample was a concern about informed consent. The second most common theme was perceived lack of safety from side effects and unanticipated long-term risks. Limited efficacy of PEIs was also commonly mentioned, but primarily by psychiatrists compared to other groups. The final theme that emerged was a broader concern about social justice.

3.2.1. Informed consent

A majority of subjects in each stakeholder group expressed concerns related to informed consent, particularly the challenge of providing adequate information in ways that patients could understand. In addition, ome patients and members of the public were concerned with the possibility of ECT, in particular, being used involuntarily.

“[It is important to] take the time to have full discussions with patients so that they can make, meaningful choices of their treatment options.” (Psychiatrist 11)

“[T]hat the patient really can give informed consent and that they really know and understand the risk versus the benefits.” (Patient 10)

“[M]aking sure that you’re really getting a truly informed consent of what sort of procedure is being done.” (Public 01)

3.2.2. Safety Concerns

Ethical concerns about safety primarily were related to protection from side effects and unforeseen long-term risks. Psychiatrists expressed concerns about how to recognize and manage side effects. Patients and the public primarily raised concerns about the lack of safety information on those PEIs still under investigation and the perception that PEIs likely have greater side effects than do other types of treatments.

“Compilation of side effects in the acute state and a compilation of appropriate management strategies for those side effects in the acute state, and then the same thing in the maintenance phase [are important ethical issues].” (Psychiatrist 10)

“[A] lot of them are still in like clinical trials, so you don’t know if they’re 100% safe.” (Patient 8)

“I know they’re not all 100% effective, and if they’re not effective and there’s more side effects, is it worth really going through the risk of giving those therapies to patients.” (Public 2)

3.2.3. Limited effectiveness

More than half of psychiatrists, but only approximately one-third of patients and the public, mentioned ethical concerns about the potentially limited efficacy of PEIs. The theme of “limited effectiveness” emerged from the data when participants were asked about ethical concerns. In the bioethical literature, effectiveness as such is generally not discussed as an ethical consideration. However, it is entangled with the principles of beneficence and maleficence. Psychiatrists tended to discuss the limited efficacy of TMS and DBS, while patients and public focused more on concerns about ECT’s efficacy.

“[T]he large studies sort of failed to show efficacy and so at this point, I think it’s suspended [referring to DBS].” (Psychiatrist 6)

“[H]ow effective is it, and is it really beneficial to do the ECT?” (Patient 5)

3.2.4. Social justice

The final ethical concern highlighted the need to ensure fair and equitable access to effective and beneficial interventions. For example, several participants noted that marginalized populations may experience disproportionate barriers to access PEIs, including heightened transportation and economic burdens.

“They’re getting withheld from people that may need them. That’s one concern I have as a physician now.” (Psychiatrist 5)

“I do worry about socioeconomic status, and race, and ethnicity all could play into that. Where you would offer more options to someone who had a larger bank account.” (Patient 7)

“With the medical system here in United States, I think a lot of people don’t have access to those kinds of things. I think that an elite [group] of people will have access to them and not everybody.” (Public 09)

3.2.5. Ethical Concerns specific to PEIs

When asked if they thought that PEIs raised different ethical issues than other types of psychiatric interventions, members of the public, and a few patients, said that there are more concerns with PEIs because they have not been around for as long as medication or psychotherapy, or because of the tainted history of biological psychiatric interventions.

“I don’t think there’s anything inherently wrong with any of these treatments. I’m sure there are people who have been giving them inappropriately, but I wouldn’t hold that against ECT. I wouldn’t hold that against DBS. I wouldn’t hold that against psychotherapy.” (Public 7)

“I think that my concerns will be bigger with the electrical than the medications because medications have been used for a long time, and so there is more knowledge in that field.” (Public 9)

4. Discussion

This study examined perceived barriers to and other ethical concerns about using PEIs for treating depression among psychiatrists, people living with depression, and members of the public. Majorities of each stakeholder group perceived access limitations as a major structural barrier and low mental health literacy as a major attitudinal barrier. Further, a majority in each stakeholder group expressed challenges to informed consent as an important ethical concern. While these results reinforce those reported in recent studies of mental health treatments generally (Andrade et al., 2013; Bell et al., 2014; Blease, 2013; Cabrera et al., 2014; Fins, 2009; Mechanic, 2002; Mojtabai et al., 2010; Rossi et al., 2009; Tomczyk et al., 2020), our comparative approach extends this literature by simultaneously identifying similarities and differences across stakeholder groups and PEI modalities.

4.1. Limited access

Our results suggest that electroceuticals may face stronger structural barriers to use than other types of mental health treatments, though further research is needed to confirm this claim. Our participants believed that PEIs are even less likely to be available than other mental health treatments, due to the lack of equipment and of providers who offer these interventions, including geographical proximity to clinics that provide PEIs.

In the case of implantable PEIs, which will require even more specialized neurosurgical treatment and equipment, geographical distance to medical academic centers where these procedures are likely to be offered is a further limitation (Goldbloom and Gratzer, 2019). Additionally, not all psychiatrists have been trained sufficiently on PEI procedures. In fact, the Accreditation Council for Graduate Medical Education only requires that psychiatry residents demonstrate knowledge of ‘indications for’ and ‘uses of’ electroconvulsive and neuromodulation therapies as a graduation requirement (ACGME, 2019).

Moreover, the US has a noticeable shortage of psychiatrists (National Council Medical Director Institute, 2017), and an increasing demand for mental health treatments. As previous studies have found (Tomczyk et al., 2020), a lack of provider referrals to PEI interventions likely contributed to the limited availability of PEIs, especially regarding surgical psychiatric interventions, such as DBS (Cormier et al., 2019; M. I. Hariz and G. M. Hariz, 2012). Since TMS was FDA-approved for depression in 2008, the number of private TMS clinics has increased (Hutton, 2014). However, this increase may not address the access problem for everyone, since these private clinics tend to be located in densely populated areas rather than in rural areas that are medically underserved. Private clinics can also lead to increased variability in administrative processes, treatment guidelines, insurance coverage, and cost.

Financial barriers to mental health treatment have increased historically (Mojtabai et al., 2010, Rowan et al., 2013) and were mentioned by all three stakeholder groups. Psychiatrists were concerned with barriers related to insurance coverage and prior authorizations, while patients paid the most attention to actual out-of-pocket costs. For example, while TMS has substantially lower out-of-pocket costs than other PEIs (without insurance coverage, the out-of-pocket cost of a course of TMS is approximately $10,000 (Rasmussen, 2011)), insurance companies are still reluctant to cover the procedure. Newer TMS devices and protocols are being established which might not be FDA-approved, further complicating reimbursement. Despite the increased barrier for insurance coverage of TMS compared to ECT, some studies suggest that TMS is more cost-effective than ECT (Fitzgibbon et al., 2020) and than pharmaceuticals (Nguyen and Gordon, 2015) for TRD.

Additionally, several insurance companies require a stepped protocol, in which patients must “fail” several lower-cost treatments, such as medication, before trialing more expensive options (Hoffman, 2018), which could further discourage the use of PEIs. The 2008 Mental Health Parity and Addiction Equity Act (https://www.congress.gov/bill/110th-congress/house-bill/1424) requires insurance coverage for mental health conditions to be no more restrictive than coverage for other medical conditions (Busch, 2012). However, even today, many insurance plans in the US have failed to comply with all aspects of this law (Davenport et al. 2019), particularly with regard to prior authorizations, reimbursement rates, and network designs. While several advocacy and medical groups have supported the enforcement of the law (e.g., American Psychiatric Association), fair and equitable insurance coverage still remains an issue for those seeking treatment for mental health disorders, further reducing access to these types of treatments.

4.2. Low mental health literacy

Mental health literacy is associated with individuals’ decision-making regarding mental health, especially help-seeking behaviors for psychiatric symptoms (Kutcher et al., 2016; Furnham and Swami, 2018).

Despite much effort by health organizations to raise mental health literacy, the public is still only vaguely aware of most types of psychiatric disorders and the availability of effective treatments. Similar to our study, Cormier and colleagues found that approximately 83% of their sampled psychiatrists and residents considered their level of knowledge of DBS to be weak or poor (Cormier et al., 2019). It is possible that DBS may be particularly prone to knowledge deficits, given its investigational status.

Stigma associated with seeking specialty mental health services prevents many individuals living with depression or other severe mental illnesses from pursuing and obtaining adequate psychiatric care (Mechanic, 2002). Consistent with prior studies (McFarquhar and Thompson, 2008; Wilhelmy et al., 2018, Wilkinson et al., 2021), our stakeholder groups perceived PEIs, especially ECT, to be especially stigmatized. Media-driven stereotypes of psychiatric treatments—especially ECT—endure, likely reducing public recognition of improvements in how procedures are performed.

4.3. Time constraints and limitations on caregiver support

To the best of our knowledge, no studies have substantially investigated time constraints as a barrier to PEI treatment, though Kessler et al. (2001) found that almost one-third of patients did not seek mental health treatment in general because it takes too much time.

Approved TMS protocols typically involve four to five sessions per week for four to six weeks, equalling 20–30, 45-minute treatment sessions (Rasmussen, 2011), and our participants frequently identified time commitment as a potential barrier. To receive treatment so frequently requires one to have adequate and reliable transportation, funds for travel, time available from work or other life responsibilities. While newer TMS modalities, such as low-frequency magnetic stimulation, are less time-consuming (Somani and Kar, 2019), they also tend to be less available and not covered by insurance.

Even though ECT is administered less often (usually six to twelve sessions conducted two or three times weekly (American Psychiatric Association, 2010), the time required for anesthesia and recovery is nevertheless a substantial barrier. Also the general anesthesia used during ECT requires a patient to have someone transport them to and from the treatment facility. While our participants did not mention these themes regarding DBS, the fact that this intervention involves a neurosurgical procedure creates the need for a caregiver not only for transportation, but also potentially for physical and emotional support during recovery. Moreover, there are pre- and post-operative follow-up visits, including several evaluations, and consultations, for battery replacement (Ramirez-Zamora et al., 2018), which are time-intensive.

4.4. Neuroethical considerations

Informed consent is both an ethical and a legal obligation that allows patients to make educated decisions about their own health care. Its legitimacy requires that patients fully understand the information available to inform their decision-making. How PEIs work when treating depression, their effectiveness, and their long-term side effects are not fully understood. For example, if there is limited evidence of effectiveness, we may be putting patients at risk of not getting appropriate treatment, and they may experience side effects without compensating treatment benefits. This underscores the importance of ensuring that healthcare professionals are transparent when discussing the unknown elements of these treatments.

Another consideration related to informed consent is patients’ decision-making capacity, especially as PEIs are typically used for severe or treatment-resistant cases of depression (Beeker et al., 2017; Dunn et al., 2011; Mandarelli et al., 2018). A psychiatric diagnosis does not preclude intact decision-making capacity, but capacity may be compromised in some treatment-refractory cases. A survey on medical professionals’ attitudes about the unique ethical, legal, and policy questions that DBS presents revealed concern about the fidelity of the consent process (Ali et al., 2016). Similarly, Lawrence and colleagues interviewed psychiatric inpatients with TRD and found that they believed their depression interfered with their ability to effectively weigh risks and benefits of treatment options(Lawrence et al., 2019). Involuntary treatment usually occurs only in cases of emergency, much less often than popular culture depicts. Interestingly, Takamiya and colleagues found that 80% of patients surveyed reported overall satisfaction with and positive attitudes toward ECT regardless of whether voluntary consent was secured or if it was used on an involuntary basis (Takamiya et al., 2019).

Finally, neuroethicists—and bioethicists more generally—are increasingly focusing on social justice considerations, including how individuals with limited resources and lower socioeconomic status may be disproportionately affected, as poverty is correlated with higher burden of mental illness (Lake, 2017). Effectiveness is also entangled with principles of justice. For example, we may be wasting resources on treatments that are not bringing a benefit to patients.

Overall, our results highlight the importance of allocating resources towards the dissemination of information about structural aspects of care, including raising awareness of available mental health services and service providers, and information about the accessibility of services. Furthermore, this is the first study examining perceptions of a range of neurostimulation and neuromodulation interventions across several stakeholder groups. The few studies of barriers to the use of PEIs that do exist only consider ECT. Given that ECT has been controversial and is often misunderstood by patients and the public, generalizing these results to other PEIs may not be warranted and one cannot assume similar barriers are perceived across other types of PEIs. Prior to our study, there was no empirical evidence that there were similar perceived barriers. Our study therefore helps to form the bedrock of our understanding of PEIs by filling a gap in the literature.

Limitations

All study participants lived in Michigan, which limits the generalizability of our results. Interview studies, while enabling the exploration of meaning and generating rich data, have as a limitation the lack of representativeness. Further, the depressed patients and members of the public in our study were more highly educated than what we would expect using a nationally representative sample—potentially skewing our results. The use of open-ended questions in semi-structured interviews is appropriate for gathering rich information during the early stages of qualitative research, but it makes comparison among individuals and across stakeholder groups challenging. Another limitation that inhibits comparisons across interviews is that, due to time constraints, not all participants were asked about all PEIs. Lastly, as with all elective research, we can only minimize and not eliminate selection bias. The goal of this study was to provide a framework for the next stage of our project, informing the development of a quantitative survey instrument for implementation in a nationally representative sample of patients, caregivers, the general public, and psychiatrists—that will overcome some of these limitations with representative sampling and objective measures and scales.

Supplementary Material

Supplementary Material

S1 Document. Fact sheet summarizing PEIs in project

S2 Document. Section on perceived barriers and other ethical concerns

S3 Document, Participants’ Experience with or Knowledge of PEIs

Acknowledgements

The authors thank our study participants for sharing their views, which helped us shape our research and launch our next phase of this study. We also thank Emily Castillo, Marissa Cortright, and Megan Penzkofer, who have assisted in the planning, development, and analysis of our project. We further thank our Scientific Advisory Board and external consultant for their valuable input into our project.

Funding:

This work was supported by a National Institutes of Health BRAIN Innitiative grant [grant number #RF1MH117802].

References

  1. ACGME, 2019. ACGME Program Requirements for Graduate Medical Education in Psychiatry 1–63. [Google Scholar]
  2. Ali R, DiFrancesco MF, Ho AL, Kampman KM, Caplan AL, Halpern CH, 2016. Attitudes Toward Treating Addiction with Deep Brain Stimulation. Brain Stimulation 9, 466–468. doi: 10.1016/j.brs.2016.03.009 [DOI] [PubMed] [Google Scholar]
  3. American Psychiatric Association, 2010. Practice guideline for the treatment of patients with major depressive disorder. APA. [PubMed] [Google Scholar]
  4. Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, Bromet E, Bruffaerts R, de Girolamo G, de Graaf R, Florescu S, Gureje O, Hinkov HR, Hu C, Huang Y, Hwang I, Jin R, Karam EG, Kovess-Masfety V, Levinson D, Matschinger H, O’Neill S, Posada-Villa J, Sagar R, Sampson NA, Sasu C, Stein DJ, Takeshima T, Viana MC, Xavier M, Kessler RC, 2013. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol. Med. 44, 1303–1317. doi: 10.1017/S0033291713001943 [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. APA. 2001. The Practice of Electroconvulsive Therapy: Recommendations for Treatment, Training, and Privileging: A Task Force Report of the American Psychiatric Association, 2nd ed. [DOI] [PubMed]
  6. Baylis F, 2013. “I Am Who I Am”: On the Perceived Threats to Personal Identity from Deep Brain Stimulation. Neuroethics 6, 513–526. doi: 10.1007/s12152-011-9137-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Beeker T, Schlaepfer TE, Coenen VA, 2017. Autonomy in Depressive Patients Undergoing DBS-Treatment: Informed Consent, Freedom of Will and DBS’ Potential to Restore It. Frontiers in integrative Neuroscience 11, 33–11. doi: 10.3389/fnint.2017.00011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bell E, Racine E, Chiasson P, Dufourcq-Brana M, Dunn LB, Fins JJ, Ford PJ, Glannon W, Lipsman N, Macdonald ME, Mathews DJH, McAndrews MP, 2014. Beyond consent in research. Cambridge Quarterly of Healthcare Ethics 23, 361–368. doi: 10.1017/S0963180113000984 [DOI] [PubMed] [Google Scholar]
  9. Blease CR, 2013. Electroconvulsive therapy, the placebo effect and informed consent. J Med Ethics 39, 166–170. doi: 10.1136/medethics-2012-100955 [DOI] [PubMed] [Google Scholar]
  10. Busch SH, 2012. Implications of the Mental Health Parity and Addiction Equity Act. Am J Psychiatry 169, 1–3. doi: 10.1176/appi.ajp.2011.11101543 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud P-AC, & Rubin HR (1999). Why Don’t Physicians Follow Clinical Practice Guidelines?: A Framework for Improvement. JAMA: the Journal of the American Medical Association, 282(15), 1458–1465. 10.1001/jama.282.15.1458 [DOI] [PubMed] [Google Scholar]
  12. Cabrera LY, Bittlinger M, Lou H, Müller S, Illes J, 2018a. Reader comments to media reports on psychiatric neurosurgery: past history casts shadows on the future. Acta Neurochir 160, 1–7. doi: 10.1007/s00701-018-3696-4 [DOI] [PubMed] [Google Scholar]
  13. Cabrera LY, Brandt M, McKenzie R, Bluhm R, 2019. Online comments about psychiatric neurosurgery and psychopharmacological interventions_ Public perceptions and concerns. Social Science & Medicine 220, 184–192. doi: 10.1016/j.socscimed.2018.11.021 [DOI] [PubMed] [Google Scholar]
  14. Cabrera LY, Evans EL, Hamilton RH, 2014. Ethics of the electrified mind: Defining issues and perspectives on the principled use of brain stimulation in medical research and clinical care. Brain Topography 27, 33–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Cabrera LY, McKenzie R, Bluhm R, 2018b. Conflicts of interest and industry professional relationships in psychiatric neurosurgery: a comparative literature review. Acta Neurochir 45, E20. [DOI] [PubMed] [Google Scholar]
  16. Cormier J, Iorio-Morin C, Mathieu D, Ducharme S, 2019. Psychiatric Neurosurgery: A Survey on the Perceptions of Psychiatrists and Residents. Canadian Journal of Neurological Sciences 46, 303–310. doi: 10.1017/cjn.2019.5 [DOI] [PubMed] [Google Scholar]
  17. Davenport S, Gray TJ, Melek SP. 2019. Addiction and mental health vs. physical health: widening disparities in network use and provider reimbursement. Milliman Research Report. Nov:1–140. https://www.milliman.com/en/insight/addiction-and-mental-health-vs-physical-health-widening-disparities-in-network-use-and-p
  18. de Haan S, Rietveld E, Stokhof M, Denys D, 2017. Becoming more oneself? Changes in personality following DBS treatment for psychiatric disorders: Experiences of OCD patients and general considerations. PLoS ONE 12, e0175748–27. doi: 10.1371/journal.pone.0175748 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Dunn L, Holtzheimer P, Hoop J, Mayberg H, Roberts LW, Appelbaum P, 2011. Ethical Issues in Deep Brain Stimulation Research for Treatment-Resistant Depression: Focus on Risk and Consent. AJOB Neurosc 2, 29–36. doi: 10.1080/21507740.2010.533638 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Fins JJ, 2009. Deep Brain Stimulation: Ethical Issues in Clinical Practice and Neurosurgical Research, in: Neuromodulation. Elsevier, pp. 81–91. doi: 10.1016/B978-0-12-374248-3.00010-0 [DOI] [Google Scholar]
  21. Fitzgibbon KP, Plett D, Chan BCF, Hancock-Howard R, Coyte PC, Blumberger DM, 2020. Cost-Utility Analysis of Electroconvulsive Therapy and Repetitive Transcranial Magnetic Stimulation for Treatment-Resistant Depression in Ontario. The Canadian Journal of Psychiatry 65, 164–173. doi: 10.1177/0706743719890167 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Furnham A, Swami V, 2018. Mental health literacy: A review of what it is and why it matters. International Perspectives in Psychology: Research, Practice, Consultation 7, 240–257. doi: 10.1037/ipp0000094 [DOI] [Google Scholar]
  23. Gilbert F, 2015. A Threat to Autonomy? The Intrusion of Predictive Brain Implants. AJOB Neurosc 6, 4–11. doi: 10.1080/21507740.2015.1076087 [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Glannon W, 2014. Neuromodulation, Agency and Autonomy. Brain Topography 27, 46–54. [DOI] [PubMed] [Google Scholar]
  25. Goering S, 2015. Stimulating Autonomy: DBS and the Prospect of Choosing to Control Ourselves Through Stimulation. AJOB Neurosc 6, 1–3. doi: 10.1080/21507740.2015.1106274 [DOI] [Google Scholar]
  26. Goering S, 2014. Is it Still Me? DBS, Agency, and the Extended, Relational Me. AJOB Neurosc 5, 50–51. doi: 10.1207/S15327957PSPR0604_06 [DOI] [Google Scholar]
  27. Goering S, Klein E, Dougherty DD, Widge AS, 2017. Staying in the Loop: Relational Agency and Identity in Next-Generation DBS for Psychiatry. AJOB Neurosc 8, 59–70. doi: 10.1080/21507740.2017.1320320 [DOI] [Google Scholar]
  28. Goldbloom DS, Gratzer D, 2019. Barriers to Brain Stimulation Therapies for Treatment-Resistant Depression: Beyond Cost Effectiveness. Can J Psychiatry 070674371989358–3. doi: 10.1177/0706743719893584 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Hariz MI, Hariz GM, 2012. Hyping deep brain stimulation in psychiatry could lead to its demise. BMJ : British Medical Journal 345, e5447–e5447. doi: 10.1136/bmj.e5447 [DOI] [PubMed] [Google Scholar]
  30. Hoffman S, 2018. Step Therapy: Legal, Ethical, and Policy Implications of a Cost-Cutting Measure. Food and Drug Law Journal 73, 38–65. doi: 10.2307/26661167?refreqid=search-gateway:73c23798510f97151ba9554dddd42d9a [DOI] [Google Scholar]
  31. Hsieh HF, Shannon SE, 2005. Three Approaches to Qualitative Content Analysis. Qualitative Health Research 15, 1277–1288. doi: 10.1177/1049732305276687 [DOI] [PubMed] [Google Scholar]
  32. Hutton TM, 2014. The Clinical Application of Transcranial Magnetic Stimulation. Psychiatric Annals 44, 305–309. doi: 10.3928/00485713-20140609-09 [DOI] [Google Scholar]
  33. Johansson V, Garwicz M, Kanje M, Schouenborg J, Tingström A, Görman U, 2011. Authenticity, Depression, and Deep Brain Stimulation. Frontiers in integrative Neuroscience 5. doi: 10.3389/fnint.2011.00021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Jotterand F, Giordano J, 2011. Transcranial magnetic stimulation, deep brain stimulation and personal identity: Ethical questions, and neuroethical approaches for medical practice. Int Rev Psychiatry 23, 476–485. doi: 10.3109/09540261.2011.616189.2011.616189 [DOI] [PubMed] [Google Scholar]
  35. Kessler RC, Berglund PA, Bruce ML, Koch JR, Laska EM, Leaf PJ, Manderscheid RW, Rosenheck RA, Walters EE, Wang PS, 2001. The prevalence and correlates of untreated serious mental illness. Health Services Research 36, 987–1007. [PMC free article] [PubMed] [Google Scholar]
  36. Klein E, Brown T, Sample M, Truitt AR, Goering S, 2015. Engineering the Brain: Ethical Issues and the Introduction of Neural Devices. Hastings Center Report 45, 26–35. doi: 10.1002/hast.515 [DOI] [PubMed] [Google Scholar]
  37. Kraemer F, 2011. Me, Myself and My Brain Implant: Deep Brain Stimulation Raises Questions of Personal Authenticity and Alienation. Neuroethics 6, 483–497. doi: 10.1007/s12152-011-9115-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Kutcher S, Wei Y, Coniglio C, 2016. Mental Health Literacy. Can J Psychiatry 61, 154–158. doi: 10.1177/0706743715616609 [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Lake J, 2017. Urgent Need for Improved Mental Health Care and a More Collaborative Model of Care. permj 1–8. doi: 10.7812/TPP/17-024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Lauber C, Nordt C, Falcato L, Rössler W, 2005. Can a seizure help? The public’s attitude toward electroconvulsive therapy. Psychiatry Research 134, 205–209. doi: 10.1016/j.psychres.2004.07.010 [DOI] [PubMed] [Google Scholar]
  41. Lawrence RE, Kaufmann CR, DeSilva R, Appelbaum PS, 2019. Patients’ beliefs about deep brain stimulation for treatment-resistant depression. American Journal of Bioethics 9, 210–218. doi: 10.1080/21507740.2018.1553897 [DOI] [Google Scholar]
  42. Lipsman N, Glannon W, 2013. Brain, mind and machine: What are the implications of deep brain stimulation for perceptions of personal identity, agency and free will? Bioethics 27, 465–470. doi: 10.1111/j.1467-8519.2012.01978.x [DOI] [PubMed] [Google Scholar]
  43. Livingston R, Wu C, Mu K, Coffey MJ, 2017. Regulation of Electroconvulsive Therapy. The Journal of ECT 1–9. doi: 10.1097/YCT.0000000000000460 [DOI] [PubMed] [Google Scholar]
  44. Mandarelli G, Moretti G, Pasquini M, Nicolò G, Ferracuti S, 2018. Informed Consent Decision-Making in Deep Brain Stimulation. Brain Sciences 8, 84–13. doi: 10.3390/brainsci8050084 [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. McClintock SM, Reti IM, Carpenter LL, et al. Consensus Recommendations for the Clinical Application of Repetitive Transcranial Magnetic Stimulation (rTMS) in the Treatment of Depression. Journal of Clinical Psychiatry. 2018;79(1):16cs10905. doi: 10.4088/JCP.16cs10905 [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. McFarquhar TF, Thompson J, 2008. Knowledge and attitudes regarding electroconvulsive therapy among medical students and the general public. The Journal of ECT 24, 244–253. doi: 10.1097/YCT.0b013e318168be4a [DOI] [PubMed] [Google Scholar]
  47. Mechanic D, 2002. Removing barriers to care among persons with psychiatric symptoms. Health Affairs 21, 137–146. doi: 10.1377/hlthaff.21.3.137 [DOI] [PubMed] [Google Scholar]
  48. Mental Health America, 2016. Shortening the Road to Recovery: Barriers and Opportunities to Improve Quality of Care for Major Depressive Disorder.
  49. Mojtabai R, Olfson M, Sampson NA, Jin R, Druss B, Wang PS, Wells KB, Pincus HA, Kessler RC, 2010. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol. Med. 41, 1751–1761. doi: 10.1017/S0033291710002291 [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. National Council Medical Director Institute, 2017. The Psychiatric Shortage. National Council Medical Director Institute; 1–66. [Google Scholar]
  51. Nguyen K-H, Gordon LG, 2015. Cost-Effectiveness of Repetitive Transcranial Magnetic Stimulation versus Antidepressant Therapy for Treatment-Resistant Depression. Value Health 18, 597–604. doi: 10.1016/j.jval.2015.04.004 [DOI] [PubMed] [Google Scholar]
  52. Perera T, George MS, Grammer G et al. The Clinical TMS Society Consensus Review and Treatment Recommendations for TMS Therapy for Major Depressive Disorder. Brain Stimulation. 2016;9(3):336–346. doi: 10.1016/j.brs.2016.03.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Ramirez-Zamora A, Giordano JJ, Gunduz A, Brown P, Sanchez JC, Foote KD, Almeida L, Starr PA, Bronte-Stewart HM, Hu W, McIntyre C, Goodman W, Kumsa D, Grill WM, Walker HC, Johnson MD, Vitek JL, Greene D, Rizzuto DS, Song D, Berger TW, Hampson RE, Deadwyler SA, Hochberg LR, Schiff ND, Stypulkowski P, Worrell G, Tiruvadi V, Mayberg HS, Jimenez-Shahed J, Nanda P, Sheth SA, Gross RE, Lempka SF, Li L, Deeb W, Okun MS, 2018. Evolving Applications, Technological Challenges and Future Opportunities in Neuromodulation: Proceedings of the Fifth Annual Deep Brain Stimulation Think Tank. Frontiers in Neuroscience 11, 343–25. doi: 10.3389/fnins.2017.00734 [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Rasmussen KG, 2011. Some Considerations in Choosing Electroconvulsive Therapy Versus Transcranial Magnetic Stimulation for Depression. The Journal of ECT 27, 51–54. doi: 10.1097/YCT.0b013e3181da84c6 [DOI] [PubMed] [Google Scholar]
  55. Rossi S, Hallett M, Rossini PM, Pascual-Leone A, 2009. Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research. Clinical Neurophysiology 120, 2008–2039. doi: 10.1016/j.clinph.2009.08.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Rowan K, McAlpine DD, Blewett LA. 2013. Access and cost barriers to mental health care, by insurance status, 1999–2010. Health Aff 32(10):1723–1730. doi: 10.1377/hlthaff.2013.0133 [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Saldana J 2008. The coding manual for qualitative researchers. 1st ed. Los Angeles: Sage. [Google Scholar]
  58. Sandelowski M, 2000. Focus on Research Methods Whatever Happened to Qualitative Description? Research in Nursing Health 23, 334–340. [DOI] [PubMed] [Google Scholar]
  59. Somani A, Kar SK, 2019. Efficacy of repetitive transcranial magnetic stimulation in treatment-resistant depression: the evidence thus far. Gen Psych 32, e100074–8. doi: 10.1136/gpsych-2019-100074 [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Synofzik M, Schlaepfer TE, 2008. Stimulating personality: Ethical criteria for deep brain stimulation in psychiatric patients and for enhancement purposes. Biotechnol. J. 3, 1511–1520. doi: 10.1002/biot.200800187 [DOI] [PubMed] [Google Scholar]
  61. Takamiya A, Sawada K, Mimura M, Kishimoto T, 2019. Attitudes Toward Electroconvulsive Therapy Among Involuntary and Voluntary Patients. The Journal of ECT 35, 165–169. doi: 10.1097/YCT.0000000000000571 [DOI] [PubMed] [Google Scholar]
  62. Tomczyk S, Schmidt S, Muehlan H, Stolzenburg S, Schomerus G, 2020. A Prospective Study on Structural and Attitudinal Barriers to Professional Help-Seeking for Currently Untreated Mental Health Problems in the Community. J Behav Health Serv Res 47, 1–16. doi: 10.1007/s11414-019-09662-8 [DOI] [PubMed] [Google Scholar]
  63. Wilhelmy S, Rolfes V, Grözinger M, Chikere Y, Schöttle S, Groß D, 2018. Knowledge and attitudes on electroconvulsive therapy in Germany_ A web based survey. Psychiatry Research 262, 407–412. doi: 10.1016/j.psychres.2017.09.015 [DOI] [PubMed] [Google Scholar]
  64. Wilkinson ST, Kitay BM, Harper A, Rhee TG, Sint K, Ghosh A, Lopez MO, Saenz S, Tsai J 2021. Barriers to the implementation of Electroconvulsive Therapy (ECT): Results from a nationwide survey of ECT practitioners. Psychiatr Serv 72(7):752–757. doi: 10.1176/appi.ps.202000387. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material

S1 Document. Fact sheet summarizing PEIs in project

S2 Document. Section on perceived barriers and other ethical concerns

S3 Document, Participants’ Experience with or Knowledge of PEIs

RESOURCES