ÌÇÐÄvlog

[Skip to Navigation]
Sign In
Table 1. ÌýComparison of Characteristics of 351 Municipalities in Massachusetts in the First Quarter of 2013 and the Fourth Quarter of 2018
Table 2. ÌýChanges in Level and Slope of Opioid Fatality Rates After Implementationa of Naloxone Standing Order Across 351 Municipalities in Massachusetts From the First Quarter of 2013 to the Fourth Quarter of 2018
Table 3. ÌýInterrupted Time Series Poisson Regression Model of the Associations of Implementing Standing Order Naloxone Dispensing With Opioid Fatality Rate Across 351 Municipalities in Massachusetts From the First Quarter of 2013 to the Fourth Quarter of 2018
Table 4. ÌýPost Hoc Sensitivity Analyses of the Associations of Implementing Standing-Order Naloxone Dispensing With Opioid Fatality Rate Across 351 Municipalities in Massachusetts From the First Quarter of 2013 to the Fourth Quarter of 2018
1.
Ahmad ÌýFB, Cisewski ÌýJA, Rossen ÌýLM, Sutton ÌýP. Provisional drug overdose death counts. National Center for Health Statistics. 2023. Accessed September 17, 2023.
2.
US Department of Health & Human Services. Overdose prevention strategy. Accessed January 10, 2023.
3.
The White House. National drug control strategy. Accessed January 10, 2023.
4.
Dowell ÌýD, Ragan ÌýKR, Jones ÌýCM, Baldwin ÌýGT, Chou ÌýR. ÌýCDC clinical practice guideline for prescribing opioids for pain—United States, 2022.Ìý ÌýMMWR Recomm Rep. 2022;71(3):1-95. doi:
5.
The Network for Public Health Law. Opioid misuse and overdose prevention: 50-state survey. Accessed April 9, 2021.
6.
Gangal ÌýNS, Hincapie ÌýAL, Jandarov ÌýR, Frede ÌýSM, Boone ÌýJM, Heaton ÌýPC. ÌýPhysician-approved protocols increase naloxone dispensing rates.Ìý ÌýJ Addict Med. 2022;16(3):317-323. doi:
7.
Gangal ÌýNS, Hincapie ÌýAL, Jandarov ÌýR, Ìýet al. ÌýAssociation between a state law allowing pharmacists to dispense naloxone without a prescription and naloxone dispensing rates.Ìý Ìý´³´¡²Ñ´¡ Netw Open. 2020;3(1):e1920310. doi:
8.
Guy ÌýGP ÌýJr, Khushalani ÌýJS, Jackson ÌýH, Sims ÌýRSC, Arifkhanova ÌýA. ÌýTrends in state-level pharmacy-based naloxone dispensing rates, 2012-2019.Ìý ÌýAm J Prev Med. 2021;61(6):e289-e295. doi:
9.
US Food and Drug Administration. FDA approves first over-the-counter naloxone nasal spray: agency continues to take critical steps to reduce drug overdose deaths being driven primarily by illicit opioids. News release. March 29, 2023. Accessed April 9, 2023.
10.
Walley ÌýAY, Xuan ÌýZ, Hackman ÌýHH, Ìýet al. ÌýOpioid overdose rates and implementation of overdose education and nasal naloxone distribution in Massachusetts: interrupted time series analysis.Ìý Ìýµþ²Ñ´³. 2013;346:f174. doi:
11.
Pollini ÌýRA, Joyce ÌýR, Ozga-Hess ÌýJE, Xuan ÌýZ, Green ÌýTC, Walley ÌýAY. ÌýAssessing pharmacy-based naloxone access using an innovative purchase trial methodology.Ìý ÌýJ Am Pharm Assoc (2003). 2020;60(6):853-860. doi:
12.
Razaghizad ÌýA, Windle ÌýSB, Filion ÌýKB, Ìýet al. ÌýThe effect of overdose education and naloxone distribution: an umbrella review of systematic reviews.Ìý ÌýAm J Public Health. 2021;111(8):e1-e12. doi:
13.
Coffin ÌýPO, Behar ÌýE, Rowe ÌýC, Ìýet al. ÌýNonrandomized intervention study of naloxone coprescription for primary care patients receiving long-term opioid therapy for pain.Ìý ÌýAnn Intern Med. 2016;165(4):245-252. doi:
14.
Rees ÌýDI, Sabia ÌýJJ, Argys ÌýLM, Latshaw ÌýJ, Dave ÌýD. ÌýWith a Little Help From My Friends: The Effects of naloxone Access and Good Samaritan Laws on Opioid-Related Deaths. National Bureau of Economic Research; 2017. doi:
15.
McClellan ÌýC, Lambdin ÌýBH, Ali ÌýMM, Ìýet al. ÌýOpioid-overdose laws association with opioid use and overdose mortality.Ìý ÌýAddict Behav. 2018;86:90-95. doi:
16.
Abouk ÌýR, Pacula ÌýRL, Powell ÌýD. ÌýAssociation between state laws facilitating pharmacy distribution of naloxone and risk of fatal overdose.Ìý Ìý´³´¡²Ñ´¡ Intern Med. 2019;179(6):805-811. doi:
17.
Antoniou ÌýT, Men ÌýS, Tadrous ÌýM, Leece ÌýP, Munro ÌýC, Gomes ÌýT. ÌýImpact of a publicly funded pharmacy-dispensed naloxone program on fatal opioid overdose rates: a population-based study.Ìý ÌýDrug Alcohol Depend. 2022;236:109473. doi:
18.
Tse ÌýWC, Sanfilippo ÌýP, Lam ÌýT, Dietze ÌýP, Nielsen ÌýS. ÌýCommunity pharmacy naloxone supply, before and after rescheduling as an over-the-counter drug: sales and prescriptions data, 2014-2018.Ìý ÌýMed J Aust. 2020;212(7):314-320. doi:
19.
Commonwealth of Massachusetts Executive Department Office of Governor Deval L. Patrick. Governor Patrick declares public health emergency, announces actions to address opioid addiction epidemic. News release. March 27, 2014. Accessed April 9, 2023.
20.
Pollini ÌýRA, Slocum ÌýS, Ozga ÌýJE, Ìýet al. ÌýPharmacy naloxone codispensing: A mixed methods study of practices and perspectives under a statewide standing order program.Ìý ÌýJ Am Pharm Assoc (2003). 2022;62(5):1546-1554. doi:
21.
The Commonwealth of Massachusetts Executive Office of Health and Human Services. Policy No. 2018-04: naloxone dispensing via standing order. Accessed December 10, 2022.
22.
Green ÌýTC, Bratberg ÌýJ, Baird ÌýJ, Ìýet al. ÌýRurality and differences in pharmacy characteristics and community factors associated with provision of naloxone in the pharmacy.Ìý ÌýInt J Drug Policy. 2020;85:102602. doi:
23.
Green ÌýTC, Davis ÌýC, Xuan ÌýZ, Walley ÌýAY, Bratberg ÌýJ. ÌýLaws mandating coprescription of naloxone and their impact on naloxone prescription in five US states, 2014-2018.Ìý ÌýAm J Public Health. 2020;110(6):881-887. doi:
24.
Chatterjee ÌýA, Yan ÌýS, Xuan ÌýZ, Ìýet al. ÌýBroadening access to naloxone: Community predictors of standing order naloxone distribution in Massachusetts.Ìý ÌýDrug Alcohol Depend. 2022;230:109190. doi:
25.
US Census Bureau. American Community Survey 5-year data (2009-2021). Accessed November 1, 2022.
26.
Li ÌýY, Hyder ÌýA, Southerland ÌýLT, Hammond ÌýG, Porr ÌýA, Miller ÌýHJ. Ìý311 Service requests as indicators of neighborhood distress and opioid use disorder.Ìý ÌýSci Rep. 2020;10(1):19579. doi:
27.
Binswanger ÌýIA, Stern ÌýMF, Deyo ÌýRA, Ìýet al. ÌýRelease from prison—a high risk of death for former inmates.Ìý ÌýN Engl J Med. 2007;356(2):157-165. doi:
28.
Gladden ÌýRM, O’Donnell ÌýJ, Mattson ÌýCL, Seth ÌýP. ÌýChanges in opioid-involved overdose deaths by opioid type and presence of benzodiazepines, cocaine, and methamphetamine—25 states, July-December 2017 to January-June 2018.Ìý ÌýMMWR Morb Mortal Wkly Rep. 2019;68(34):737-744. doi:
29.
Soumerai ÌýSB, Ross-Degnan ÌýD, Gortmaker ÌýS, Avorn ÌýJ. ÌýWithdrawing payment for nonscientific drug therapy. Intended and unexpected effects of a large-scale natural experiment.Ìý Ìý´³´¡²Ñ´¡. 1990;263(6):831-839. doi:
30.
Wagner ÌýAK, Soumerai ÌýSB, Zhang ÌýF, Ross-Degnan ÌýD. ÌýSegmented regression analysis of interrupted time series studies in medication use research.Ìý ÌýJ Clin Pharm Ther. 2002;27(4):299-309. doi:
31.
Kuhn ÌýL, Davidson ÌýLL, Durkin ÌýMS. ÌýUse of Poisson regression and time series analysis for detecting changes over time in rates of child injury following a prevention program.Ìý ÌýAm J Epidemiol. 1994;140(10):943-955. doi:
32.
Pan ÌýW. ÌýAkaike’s information criterion in generalized estimating equations.Ìý Ìýµþ¾±´Ç³¾±ð³Ù°ù¾±³¦²õ. 2001;57(1):120-125. doi:
33.
Dimick ÌýJB, Ryan ÌýAM. ÌýMethods for evaluating changes in health care policy: the difference-in-differences approach.Ìý Ìý´³´¡²Ñ´¡. 2014;312(22):2401-2402. doi:
34.
Peters ÌýBG, Tarpey ÌýM. ÌýAre wicked problems really so wicked: perceptions of policy problems.Ìý ÌýPolicy Soc. 2019;38(2):218-236. doi:
35.
Green ÌýTC, Case ÌýP, Fiske ÌýH, Ìýet al. ÌýPerpetuating stigma or reducing risk? Perspectives from naloxone consumers and pharmacists on pharmacy-based naloxone in 2 states.Ìý ÌýJ Am Pharm Assoc (2003). 2017;57(2S):S19-S27, 27.e4. doi:
36.
Burstein ÌýD, Baird ÌýJ, Bratberg ÌýJ, Ìýet al. ÌýPharmacist attitudes toward pharmacy-based naloxone: a cross-sectional survey study.Ìý ÌýJ Am Pharm Assoc (2003). 2020;60(2):304-310. doi:
37.
Donovan ÌýE, Bratberg ÌýJ, Baird ÌýJ, Ìýet al. ÌýPharmacy leaders’ beliefs about how pharmacies can support a sustainable approach to providing naloxone to the community.Ìý ÌýRes Social Adm Pharm. 2020;16(10):1493-1497. doi:
38.
Donovan ÌýE, Case ÌýP, Bratberg ÌýJP, Ìýet al. ÌýBeliefs associated with pharmacy-based naloxone: a qualitative study of pharmacy-based naloxone purchasers and people at risk for opioid overdose.Ìý ÌýJ Urban Health. 2019;96(3):367-378. doi:
39.
Green ÌýTC, Donovan ÌýE, Klug ÌýB, Ìýet al. ÌýRevisiting pharmacy-based naloxone with pharmacists and naloxone consumers in 2 states: 2017 perspectives and evolving approaches.Ìý ÌýJ Am Pharm Assoc (2003). 2020;60(5):740-749. doi:
40.
Green ÌýTC, Soipe ÌýA, Baloy ÌýB, Ìýet al. ÌýPharmacy on-site overdose protocols and prevention of overdose.Ìý ÌýSubst Abus. 2022;43(1):64-68. doi:
41.
Green ÌýTC, Bratberg ÌýJ, Irwin ÌýAN, Ìýet al. ÌýStudy protocol for the Respond to Prevent Study: a multi-state randomized controlled trial to improve provision of naloxone, buprenorphine and nonprescription syringes in community pharmacies.Ìý ÌýSubst Abus. 2022;43(1):901-905. doi:
42.
Altekruse ÌýSF, Cosgrove ÌýCM, Altekruse ÌýWC, Jenkins ÌýRA, Blanco ÌýC. ÌýSocioeconomic risk factors for fatal opioid overdoses in the United States: findings from the Mortality Disparities in American Communities Study (MDAC).Ìý ÌýPLoS One. 2020;15(1):e0227966. doi:
43.
Chatterjee ÌýA, Yan ÌýS, Lambert ÌýA, Ìýet al. ÌýComparison of a national commercial pharmacy naloxone data source to state and city pharmacy naloxone data sources—Rhode Island, Massachusetts, and New York City, 2013-2019.Ìý ÌýHealth Serv Res. 2023;58(5):1141-1150. doi:
44.
Heiman ÌýE, Lanh ÌýS, Moran ÌýTP, Steck ÌýA, Carpenter ÌýJ. ÌýElectronic Advisories Increase Naloxone Prescribing Across Health Care Settings.Ìý ÌýJ Gen Intern Med. 2023;38(6):1402-1409. doi:
45.
Sohn ÌýM, Talbert ÌýJC, Huang ÌýZ, Lofwall ÌýMR, Freeman ÌýPR. ÌýAssociation of naloxone coprescription laws with naloxone prescription dispensing in the United States.Ìý Ìý´³´¡²Ñ´¡ Netw Open. 2019;2(6):e196215. doi:
46.
Doe-Simkins ÌýM, Quinn ÌýE, Xuan ÌýZ, Ìýet al. ÌýOverdose rescues by trained and untrained participants and change in opioid use among substance-using participants in overdose education and naloxone distribution programs: a retrospective cohort study.Ìý ÌýBMC Public Health. 2014;14:297. doi:
47.
Jones ÌýJD, Campbell ÌýA, Metz ÌýVE, Comer ÌýSD. ÌýNo evidence of compensatory drug use risk behavior among heroin users after receiving take-home naloxone.Ìý ÌýAddict Behav. 2017;71:104-106. doi:
48.
Tse ÌýWC, Djordjevic ÌýF, Borja ÌýV, Ìýet al. ÌýDoes naloxone provision lead to increased substance use: a systematic review to assess if there is evidence of a ‘moral hazard’ associated with naloxone supply.Ìý ÌýInt J Drug Policy. 2022;100:103513. doi:
Original Investigation
Substance Use and Addiction
´¡³Ü²µ³Ü²õ³ÙÌý29, 2024

Pharmacy Naloxone Standing Order and Community Opioid Fatality Rates Over Time

Author Affiliations
  • 1Department of Community Health Sciences, Boston University School of Public Health, Boston, Massachusetts
  • 2Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts
  • 3Grayken Center for Addiction, Clinical Addiction Research and Education Unit, Section of General Internal Medicine, Department of Medicine, Boston Medical Center and Boston University School of Medicine, Boston, Massachusetts
  • 4Institute for Behavioral Health, The Heller School for Social Policy and Management at Brandeis University, Waltham, Massachusetts
  • 5Department of Behavioral Medicine and Psychiatry, West Virginia University School of Medicine, Morgantown
  • 6Department of Epidemiology and Biostatistics, West Virginia University School of Public Health, Morgantown
JAMA Netw Open. 2024;7(8):e2427236. doi:10.1001/jamanetworkopen.2024.27236
Key Points

QuestionÌý Was community implementation of pharmacy standing-order naloxone dispensing associated with municipal opioid fatality rates across municipalities in Massachusetts?

FindingsÌý In this study with interrupted time series analysis of all 351 Massachusetts municipalities, communities with pharmacies implementing standing-order naloxone dispensing was associated with reduced opioid fatality rates over time compared with municipalities that did not implement standing-order naloxone dispensing.

MeaningÌý These findings of reduced opioid fatality rates associated with standing-order naloxone dispensing support the expansion of community naloxone access, including over-the-counter naloxone, as part of a multifaceted approach to address opioid overdose.

Abstract

ImportanceÌý Despite the proliferation of pharmacy standing-order naloxone dispensing across many US states before the change to over-the-counter status, few policy analyses have evaluated the implementation of pharmacy naloxone standing orders in addressing opioid overdose fatality among communities.

ObjectiveÌý To determine whether the implementation of pharmacy standing-order naloxone was associated with lower opioid fatality rates compared with communities without pharmacies with standing-order naloxone.

Design, Setting, and ParticipantsÌý This retrospective multisite study was conducted with an interrupted time series analysis across 351 municipalities in Massachusetts over 24 quarters (from January 1, 2013, through December 31, 2018). Standing-order naloxone dispensing data were collected from 2 sources for all major chain pharmacies and many independent pharmacies, covering 70% of retail pharmacies in Massachusetts. Municipalities had various standing-order naloxone implementation inceptions during the study period. Data were analyzed from December 2021 to November 2023.

ExposureÌý The main exposure was measured by the first quarter with standing-order naloxone dispensation as the actual implementation inception.

Main Outcomes and MeasuresÌý The primary study outcome was municipal opioid fatality rate per 100 000 population obtained from the Massachusetts Registry of Vital Records and Statistics.

ResultsÌý The median (IQR) population size across 351 municipalities was 10 314 (3635 to 21 781) people, with mean (SD) proportion of female individuals was 51.1% (2.8 percentage points). Pharmacies from 214 municipalities (60.9%) reported dispensing standing-order naloxone over the study period. At the baseline of the first quarter of 2013, municipalities that eventually had standing-order naloxone had greater quarterly opioid fatality rates compared with those that never implemented standing-order naloxone (3.51 vs 1.03 deaths per 100 000 population; P &±ô³Ù; .001). After adjusting for municipal-level sociodemographic and opioid prevention factors, there was significant slope decrease of opioid fatality rates (annualized rate ratio, 0.84; 95% CI, 0.78-0.91; P < .001) following standing-order naloxone dispensing, compared with the municipalities that did not implement standing-order naloxone. There were no significant level changes of opioid fatality rates in the adjusted models. Sensitivity analyses yielded similar and significant findings.

Conclusions and RelevanceÌý These findings suggest that community pharmacy dispensing of naloxone with standing orders was associated with a relative, gradual, and significant decrease in opioid fatality rates compared with communities that did not implement the standing-order naloxone program. These findings support the expansion of naloxone access, including over-the-counter naloxone as part of a multifaceted approach to address opioid overdose.

Introduction

In the US, opioid overdose caused more than 80 000 deaths in the 12 months ending in April 2023.1 Providing access to naloxone is a core strategy for reducing opioid fatality in the US Department of Health and Human Services’ overdose prevention strategy,2 the President’s national drug control strategy,3 and the Centers for Disease Control and Prevention’s 2022 clinical practice guidelines for prescribing opioids for pain.4 Legislative efforts to expand naloxone access have been pursued to enable community pharmacists to have the authority to dispense naloxone through a standing order. By July 2020, almost every state and the District of Columbia had established a mechanism allowing naloxone dispensing via standing order or similar mechanism.5 There is evidence that these programs significantly increase naloxone access.6-8 In March of 2023, the US Food and Drug Administration approved the first naloxone formulation for over-the-counter, nonprescription use.9

Despite their proliferation, there is scarce evidence on the effect of pharmacy naloxone standing orders on opioid overdose in community settings. Most evidence focused on expanded access to naloxone, such as community, pharmacy, and coprescribing overdose education and naloxone distribution (OEND) programs.10-13 Multiple studies on state naloxone access laws across US found reduced opioid mortality,14-16 but there was evidence that the association was driven by early adopters that passed legislation before 2011.14 However, a single-site interrupted time series analysis from 2012 to 2018 in Ontario, Canada, found that pharmacy-based naloxone dispensing under Ontario’s naloxone program for pharmacies was not inversely associated with overdose fatality rates.17 These mixed results reflect differences in study design, analytic approach, and emergence of fentanyl in the supply; yet, importantly, none focused on community-level fatality rates. Because community pharmacies can be key venues for distributing naloxone, it will be useful to not only understand the associations of these standing-order naloxone with community-level fatality rates but also infer the potential associations of over-the-counter naloxone dispensing.9,18

Massachusetts declared a public health emergency in response to increasing opioid overdoses in March of 2014.19 This declaration enabled all pharmacies in Massachusetts to voluntarily obtain a standing order to dispense naloxone kits in December 2014.20 The policy was strengthened on December 1, 2017, when pharmacies were mandated to obtain a standing order permitting them to distribute naloxone without prescription. In August 2018, Massachusetts General Laws, Chapter 94C, Section 19B21 further strengthened the policy via a single statewide standing order that authorized licensed pharmacists to dispense naloxone kits to any person at risk of experiencing an opioid-related overdose.

The standing-order naloxone policy in Massachusetts provided the opportunity to investigate its association with community-level opioid overdose. Although the rapid policy development presents challenges in identifying a single critical interruption point, pharmacy dispensing data can be used to define the inception of standing-order naloxone implementation for municipalities across Massachusetts. We hypothesized that municipalities with pharmacies dispensing standing-order naloxone would have reduced opioid fatality rates compared with municipalities that did not implement standing-order naloxone programs.

Methods
Study Design and Setting

This repeated cross-sectional study was reviewed and designated as not human participant research by the institutional review boards of the West Virginia University and the Boston University Medical Campus. We conducted a multisite interrupted time series analysis of quarterly opioid fatality rates comparing municipalities where community pharmacies dispensed standing-order naloxone with those did not dispense standing-order naloxone. We included data from all 351 municipalities in Massachusetts. The analysis was conducted across 24 quarters from first quarter of 2013 to fourth quarter of 2018. This study is reported following the Strengthening the Reporting of Observational Studies in Epidemiology () reporting guideline for observational studies.

Outcome Variable

The primary outcome was the opioid fatality rate per quarter at the municipal level. We calculated rates of opioid-related drug poisonings by community of residence using in-state deaths from the electronic database maintained by the Massachusetts Registry of Vital Records and Statistics, Massachusetts Department of Public Health. Opioid-related deaths were defined by International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) codes indicating unintentional or undetermined intentional poisoning (code X40-X44, Y10-Y14) in the underlying cause of death field and an opioid-specific T code of T40.0-T40.4 and/or the narcotic T code T40.6 in any of the multiple cause-of-death fields.11

Main Exposure Variable

We used 2 sources for retail pharmacy data of standing-order naloxone distributed between 2013 and 2018. One of the authors (A.Y.W.), was the standing-order prescriber for all major chain pharmacies, except for 1, and many independent pharmacies in Massachusetts. These standing orders required pharmacies to maintain a record of each naloxone kit dispensed and report the dates and quantities to the standing order prescriber on a monthly basis. One major chain of pharmacies used their own standing-order writer during the study period. Data from this large retail chain on standing-order naloxone dispensing have been described in prior studies.22,23 We merged data from both sources, which in aggregate covered 70% of retail pharmacies in Massachusetts.24

For the interrupted time series analysis, we used the first quarter in which standing-order naloxone was dispensed as a municipality-specific inception variable. The use of the quarter for the first standing-order naloxone dispensed captured the actual implementation inception for a given municipality. Once the pharmacies in a municipality dispensed standing-order naloxone, the municipality was coded in the exposure group and remained exposed for the duration of the study. As a result, 214 of 351 municipalities had various inceptions during the study period. The cumulative number of communities with actual standing order naloxone dispensing in each year were: 0 by 2013, 17 by 2014, 140 by 2015, 196 by 2016, 209 by 2017, and 214 by 2018. The remaining 137 municipalities did not dispense standing-order naloxone through their community pharmacies during the study period.

Covariates

We obtained community demographics to adjust for potential municipal-level confounding. We obtained data from the American Community Survey 5-year estimates (2013-2018), including number of municipal residents, age group proportions (<25, 25-44, 45-54, 55-64, and ≥65 years), sex, race and ethnicity (African American or Black, American Indian or Alaska Native, Asian, Hispanic or Latinx, Pacific Islander, White, and other, which included multiracial and other group), high school education or less, and vacancy rate.25 Race and ethnicity were included because opioid use patterns differ by race and ethnicity. Vacancy rate was measured by vacant housing units per 1000 population, and vacancy rate was shown to be a marker of neighborhood distress associated with opioid overdose.26 To adjust for the proliferation of naloxone kits from certain other sources, we obtained the number of naloxone kits distributed to the communities by OEND programs funded by the Massachusetts Department of Public Health. We also obtained the number of naloxone kits dispensed through pharmacies that were not under a standing order (ie, with a prescription). Although these prescribed naloxone kits data were collected for the study period, the data since the second half of 2017 were incomplete. We conducted a sensitivity analysis to further adjust for prescribed naloxone kits rates. To adjust for the level of opioid treatment in the community, we obtained methadone treatment admissions rates and residential treatment admissions rates from the Massachusetts Bureau of Substance Addiction Services. In addition, the Prescription Monitoring Program provided patient rates of buprenorphine prescriptions, indicative of an opioid use disorder. These covariates were assessed in prior studies on opioid use.11 Given overdose risk is elevated at release from incarceration,27 we also obtained data on community release rates from the Massachusetts Department of Correction. Finally, because fentanyl in the illicit drug supply is the major driver of surging overdose deaths, we used the community-specific proportion of fentanyl-related deaths over all opioid deaths from Massachusetts Registry of Vital Records and Statistics as a proxy measure to control for fentanyl-related burden among these municipalities.28

Statistical Analysis

We used 2-sample t tests to compare the municipalities that did not have standing-order naloxone vs those dispensing standing-order naloxone. For the interrupted time series, we used the quarterly municipality-specific opioid fatality counts as the units of analysis. The total units of analysis included 28 424 town-quarters (ie, 24 quarterly measures per municipality). The municipal population based on US Census estimates was used in the log scale as a population offset. We used Poisson regression models with overdispersion adjustment to model rates with a log-linear statistical model accounting for community level covariates.11 We used the segmented regression analysis approach29,30 and included multiple time series with a generalized estimation equations approach31 to examine the population-mean changes of level and slope of fatality rate outcome after the implementation of pharmacy standing-order naloxone dispensing. We used the equation log(Yit) =‰Ӳ0 +‰Ӳ1Timeit +‰Ӳ2Programit +‰Ӳ3Time after programit + B³Ýit + eit, where Yit represents the quarterly rate outcome at municipality i and time point t, Timeit represents the time in quarter since the start of the study period, Programit is an indicator (dummy) variable representing the pharmacy standing-order naloxone dispensing program, and Time after programit represents the time in quarters after the dispensing inception date. β0 represents the intercept of the preprogram trend line at the index time, and B represents the coefficient vector of the municipal-level covariates set. We evaluated program outcomes based on the regression coefficients (β2 and β3) assuming the preimplementation trend remained unchanged. We examined quasilikelihood information criteria to assess goodness of fit and determine the covariance structure of the repeated quarterly measures within municipalities and the overdispersion of the Poisson distribution.32 We annualized β3 to represent the change of rate per year after implementation of pharmacy standing-order naloxone programs.

To ascertain robustness of our findings, we conducted 5 sensitivity analyses. First, instead of using the concurrent quarter as the first dispensing quarter, we applied 1-quarter lag by using the subsequent quarter as the starting quarter, because the date of the first standing-order naloxone dispensed may not fall at the beginning of a quarter. Second, we removed substance use disorder treatment variables (eg, methadone admission rate, residential admission rate, and patient rate of buprenorphine prescription for opioid use disorder) that could be potential mediators. Third, we further controlled for prescribed pharmacy-based naloxone kit distribution rates that could partially affect opioid overdose rates in these municipalities. Fourth, to account for potential unmeasured health system effects, we followed a prior method10 and refit the adjusted Poisson fatal overdose models replacing fatal death rates with opioid death to cancer death rate ratios for each municipality-quarter unit using data from the Massachusetts Registry of Vital Records and Statistics. We used ICD-10 codes representing malignant neoplasms (codes C000-C979) to define cancer deaths. Cancer death rate served as a potential control of the underlying health system change over the study period; thus, a significant association with the opioid-to-cancer–death rate ratio outcome would indicate that opioid deaths were associated with the standing-order naloxone program after accounting for the underlying health system changes. Fifth, because the Massachusetts state mandate for standing-order naloxone dispensing took effect in August 2018, we restricted the final sensitivity analysis to a shortened study period from the first quarter of 2013 to the second quarter of 2018 (ie, 22 quarters).

All tests used a significance level of P ≤ .05, and all P values were 2-sided. All analyses were conducted using SAS software version 9.4 (SAS Institute). Data were analyzed from December 2021 to November 2023.

Results

The mean (SD) population size across 351 municipalities was 18 818 (39 368; median [IQR], 10 314 [3635 to 21 781]), the mean (SD) proportion of female individuals was 51.1% (2.8 percentage points), and the mean (SD) age proportions were 29.2% (5.7 percentage points) younger than 25 years, 22.7% (4.8 percentage points) aged 25 to 44 years, 17.2% (3.0 percentage points) aged 45 to 54 years, 15.3% (3.9 percentage points) aged 55 to 64 years, and 15.7% (5.1 percentage points) aged 65 years or older. Pharmacies from 214 municipalities (60.9%) reported ever dispensing standing-order naloxone over the study period. The implementation of standing-order naloxone programs was mapped with the opioid fatality rates (eFigure in Supplement 1).

At the baseline of the first quarter of 2013, municipalities that eventually had standing-order naloxone dispensed in their pharmacies had greater proportions of younger, female, African American, Asian, Hispanic, or other race residents and greater rates of residential admissions compared with municipalities without standing-order naloxone dispensed in their pharmacies (Table 1). Municipalities that eventually had standing-order naloxone dispensed had larger population size and lower vacancy rate (Table 1) and a higher quarterly opioid fatality rate at baseline compared with municipalities that did not have standing-order naloxone dispensing (3.51 vs 1.03 per 100 000 population; P < .001) (Table 1).

Table 2 summarizes the changes in municipal opioid fatality rates after the implementation of standing-order naloxone dispensing from 2013 to 2018. Adjusting for municipality-level covariates and the trend of opioid fatality prior to standing-order naloxone dispensing, we did not detect a statistically significant level change in the opioid fatality rate (adjusted rate ratio [aRR], 1.09; 95% CI, 0.99 to 1.20; P = .08) after naloxone dispensing under the standing-order naloxone commenced; however, there was a significant slope decrease (annualized aRR, 0.84; 95% CI, 0.78 to 0.91; P &±ô³Ù; .001). The decrease of slope corresponded to an annual relative decrease of 16.0% of the opioid fatality rate per 100 000 population. No differential trends were detected (β = −0.010; 95% CI, −0.028 to 0.008; P = .26), thus meeting the assumption of parallel baseline trends in municipalities with and without standing-order naloxone.33 Municipalities with greater proportions of residents with only high school education or less, greater rates of inpatient residential admissions, more patients with buprenorphine prescriptions per population, and a greater proportion of fentanyl-involved opioid deaths had increased opioid fatality rates (Table 3).

All sensitivity analyses yielded consistent results with respect to no statistically significant level changes yet significant slope changes of opioid fatality rates (Table 4). First, lag-1 analysis also detected slope change (annualized aRR, 0.84; 95% CI, 0.77 to 0.91; P &±ô³Ù; .001). Statistically significant slope changes were also detected in models when removing municipal substance use disorder treatment utilization (aRR, 0.85; 95% CI, 0.78 to 0.92; P < .001) and additionally controlling for prescribed pharmacy-based naloxone kit rates (aRR, 0.84; 95% CI, 0.78 to 0.91; P &±ô³Ù; .001). In the fourth sensitivity analysis, the opioid-related overdose fatality outcomes were substituted for the ratio of opioid death rates over the cancer-related death rates. Slope change was also detected (aRR, 0.85; 95% CI, 0.81 to 0.90; P &±ô³Ù; .001). Thus, the decrease of slope in opioid fatality rates after standing-order naloxone programs was independent of underlying health system change over the study period. Finally, excluding the last 2 quarters of 2018 still resulted in a significant slope change for the opioid fatality rate (aRR, 0.87; 95% CI, 0.80 to 0.94; P &±ô³Ù; .001).

Discussion

This repeated cross-sectional study with interrupted time series analysis found that despite an uptrend of opioid fatality rate across Massachusetts, standing-order naloxone dispensing was associated with a relative, gradual, and significant decrease in opioid fatality rates in the municipalities with standing-order naloxone dispensing compared with the municipalities where pharmacies did not dispense standing-order naloxone. Our main analysis and several sensitivity analyses confirmed the association with reduced community-level opioid fatality rates.

Although we observed a reduction in the slope of opioid fatality rates over time, we did not detect an immediate change of opioid fatality rates in the adjusted models. This was true whether we anchored the policy implementation on the first standing-order naloxone dispensing event or lagged it by 1 quarter. It is possible that community pharmacies started dispensing naloxone in response to heightened opioid overdose in the communities. The lack of immediate level change was also expected, given the gradual process to make community residents aware of the standing-order prescribing of naloxone in their community pharmacies. Detecting an immediate policy impact can be challenging when policy implementation is shaped by contextual factors and time-delayed effects in a fluid and complex ecological system.34 Policy-, chain- and pharmacy-level interventions that occurred during the period of study are worth considering. For example, a multicomponent study examined barriers experienced by patients, caregivers, and pharmacists35-38; developed educational intervention materials tailored to these barriers for the pharmacy and staff39,40; and then implemented the materials through academic detailing visits.41 Such efforts may have boosted the standing-order naloxone outcomes through systemic dissemination and implementation in community pharmacies.

Municipalities with greater proportions of residents with lower education had higher opioid fatality rates. A 2020 study found that individuals with only high school education or less were more likely to die of opioid overdose compared with individuals with a graduate degree.42 This association of overdose fatality with lower education likely reflects the health impacts from structural inequities in social resources, like education.

This study conducted a multisite interrupted time series using standing-order naloxone dispensing as a natural experiment. The use of a community’s actual quarter of their first standing order naloxone dispensing also departs from prior approaches that relied on between-state naloxone access law pre-post comparison,14-16 thus yielding new evidence for the association of pharmacy naloxone dispensing with opioid fatality at the community level.

Limitations

The study has several limitations. First, our study is susceptible to residual confounding, particularly other unmeasured community-level factors. We tried to mitigate confounding by including a large set of community-level covariates. Second, although our data covered 70% of retail pharmacies in Massachusetts and should have correctly identified all pharmacies dispensing standing-order naloxone prior to state mandate in October 2018, it is possible that some pharmacies dispensed standing-order naloxone under standing orders not covered by our data. If this happened, it was likely a small proportion. A 2023 study comparing a national commercial pharmacy naloxone dataset with the same pharmacy naloxone data sources in Massachusetts used in this study found that the overall (standing order and non–standing order combined) dispensing counts were similar with the commercial dataset, though the commercial dataset counted more overall naloxone dispensed in the later quarters.43 However, the commercial dataset had no indicator for standing-order naloxone, so it is not possible to test our hypothesis with the commercial dataset. Third, we were not able to measure or include in our model coprescribing of naloxone with prescription opioids, which has been shown in multiple states to drive pharmacy naloxone dispensing,44,45 because it was not a policy mandate in Massachusetts during this time. Fourth, we only used the first standing-order naloxone dispensing quarter as the start of the intervention, and we did not capture the actual volume of standing-order naloxone per quarter during the study period. Fifth, this study also did not directly measure over-the-counter naloxone, as it was not available. However, standing-order naloxone dispensing is a close approximation of over-the-counter naloxone. We did not investigate price of naloxone as a factor in this study, as we did not have price information. A prior study showed that insurance coverage for naloxone during this period was common.20

Conclusions

The findings of this study with interrupted time series analysis provide support for implementation of standing-order naloxone dispensing and expansion of access to naloxone to address opioid overdose crisis. Our findings are also consistent with previous literature refuting the idea of naloxone as a moral hazard—that naloxone provision would lead to increased opioid use or overdose.13,46-48 With the US Food and Drug Administration’s approval of certain over-the-counter naloxone products,9 it is important to examine their diffusion across communities over time, augmentation of other formulations through existing standing-order mandates, and ultimately their impact on reducing opioid fatalities. Future research could ascertain how communities of color (eg, African American or Black, American Indian or Alaska Native, Asian, Hispanic or Latinx, Pacific Islander) or other vulnerability characteristics, such as low economic resources, could benefit from proactive, broader access to naloxone that comes from policies like standing orders or over-the-counter to overcome other barriers, including willingness to engage with first responders and readiness to administer naloxone. It would also be valuable to examine how standing-order naloxone dispensing may interact with other strategies, such as medications for opioid use disorder and referrals to recovery support services, in reducing opioid overdose.

Back to top
Article Information

Accepted for Publication: June 13, 2024.

Published: August 29, 2024. doi:10.1001/jamanetworkopen.2024.27236

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2024 Xuan Z et al. ÌÇÐÄvlog Open.

Corresponding Author: Ziming Xuan, ScD, SM, Boston University School of Public Health, Department of Community Health Sciences, Crosstown Building – CT 454, 801 Massachusetts Ave, 4th Floor, Boston, MA 02118 (zxuan@bu.edu).

Author Contributions: Dr Xuan had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Xuan, Walley, Green, Pollini.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: Xuan.

Critical review of the manuscript for important intellectual content: All authors.

Statistical analysis: Xuan, Yan, Green.

Obtained funding: Pollini.

Administrative, technical, or material support: Walley.

Supervision: Xuan, Pollini.

Conflict of Interest Disclosures: Dr Walley reported receiving grants from the National Institutes of Health during the conduct of the study and salary support from Massachusetts Department of Public Health outside the submitted work. No other disclosures were reported.

Funding/Support: This study was funded by the United States National Institute on Drug Abuse (grant No. R01DA040807; principal investigator: Dr Pollini). Dr Xuan received support from the Centers of Disease Control and Prevention (grant No. R01CE003622). Dr Green received support from the National Institute of Drug Abuse (grant No. R01DA045745) and the Agency for Healthcare Research and Quality (grant No. R18HS024021).

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Data Sharing Statement: See Supplement 2.

Additional Contributions: Katherine Waye, MPH (Boston Medical Center), assisted with the data collection efforts. She was not compensated for this work outside of her usual salary.

References
1.
Ahmad ÌýFB, Cisewski ÌýJA, Rossen ÌýLM, Sutton ÌýP. Provisional drug overdose death counts. National Center for Health Statistics. 2023. Accessed September 17, 2023.
2.
US Department of Health & Human Services. Overdose prevention strategy. Accessed January 10, 2023.
3.
The White House. National drug control strategy. Accessed January 10, 2023.
4.
Dowell ÌýD, Ragan ÌýKR, Jones ÌýCM, Baldwin ÌýGT, Chou ÌýR. ÌýCDC clinical practice guideline for prescribing opioids for pain—United States, 2022.Ìý ÌýMMWR Recomm Rep. 2022;71(3):1-95. doi:
5.
The Network for Public Health Law. Opioid misuse and overdose prevention: 50-state survey. Accessed April 9, 2021.
6.
Gangal ÌýNS, Hincapie ÌýAL, Jandarov ÌýR, Frede ÌýSM, Boone ÌýJM, Heaton ÌýPC. ÌýPhysician-approved protocols increase naloxone dispensing rates.Ìý ÌýJ Addict Med. 2022;16(3):317-323. doi:
7.
Gangal ÌýNS, Hincapie ÌýAL, Jandarov ÌýR, Ìýet al. ÌýAssociation between a state law allowing pharmacists to dispense naloxone without a prescription and naloxone dispensing rates.Ìý Ìý´³´¡²Ñ´¡ Netw Open. 2020;3(1):e1920310. doi:
8.
Guy ÌýGP ÌýJr, Khushalani ÌýJS, Jackson ÌýH, Sims ÌýRSC, Arifkhanova ÌýA. ÌýTrends in state-level pharmacy-based naloxone dispensing rates, 2012-2019.Ìý ÌýAm J Prev Med. 2021;61(6):e289-e295. doi:
9.
US Food and Drug Administration. FDA approves first over-the-counter naloxone nasal spray: agency continues to take critical steps to reduce drug overdose deaths being driven primarily by illicit opioids. News release. March 29, 2023. Accessed April 9, 2023.
10.
Walley ÌýAY, Xuan ÌýZ, Hackman ÌýHH, Ìýet al. ÌýOpioid overdose rates and implementation of overdose education and nasal naloxone distribution in Massachusetts: interrupted time series analysis.Ìý Ìýµþ²Ñ´³. 2013;346:f174. doi:
11.
Pollini ÌýRA, Joyce ÌýR, Ozga-Hess ÌýJE, Xuan ÌýZ, Green ÌýTC, Walley ÌýAY. ÌýAssessing pharmacy-based naloxone access using an innovative purchase trial methodology.Ìý ÌýJ Am Pharm Assoc (2003). 2020;60(6):853-860. doi:
12.
Razaghizad ÌýA, Windle ÌýSB, Filion ÌýKB, Ìýet al. ÌýThe effect of overdose education and naloxone distribution: an umbrella review of systematic reviews.Ìý ÌýAm J Public Health. 2021;111(8):e1-e12. doi:
13.
Coffin ÌýPO, Behar ÌýE, Rowe ÌýC, Ìýet al. ÌýNonrandomized intervention study of naloxone coprescription for primary care patients receiving long-term opioid therapy for pain.Ìý ÌýAnn Intern Med. 2016;165(4):245-252. doi:
14.
Rees ÌýDI, Sabia ÌýJJ, Argys ÌýLM, Latshaw ÌýJ, Dave ÌýD. ÌýWith a Little Help From My Friends: The Effects of naloxone Access and Good Samaritan Laws on Opioid-Related Deaths. National Bureau of Economic Research; 2017. doi:
15.
McClellan ÌýC, Lambdin ÌýBH, Ali ÌýMM, Ìýet al. ÌýOpioid-overdose laws association with opioid use and overdose mortality.Ìý ÌýAddict Behav. 2018;86:90-95. doi:
16.
Abouk ÌýR, Pacula ÌýRL, Powell ÌýD. ÌýAssociation between state laws facilitating pharmacy distribution of naloxone and risk of fatal overdose.Ìý Ìý´³´¡²Ñ´¡ Intern Med. 2019;179(6):805-811. doi:
17.
Antoniou ÌýT, Men ÌýS, Tadrous ÌýM, Leece ÌýP, Munro ÌýC, Gomes ÌýT. ÌýImpact of a publicly funded pharmacy-dispensed naloxone program on fatal opioid overdose rates: a population-based study.Ìý ÌýDrug Alcohol Depend. 2022;236:109473. doi:
18.
Tse ÌýWC, Sanfilippo ÌýP, Lam ÌýT, Dietze ÌýP, Nielsen ÌýS. ÌýCommunity pharmacy naloxone supply, before and after rescheduling as an over-the-counter drug: sales and prescriptions data, 2014-2018.Ìý ÌýMed J Aust. 2020;212(7):314-320. doi:
19.
Commonwealth of Massachusetts Executive Department Office of Governor Deval L. Patrick. Governor Patrick declares public health emergency, announces actions to address opioid addiction epidemic. News release. March 27, 2014. Accessed April 9, 2023.
20.
Pollini ÌýRA, Slocum ÌýS, Ozga ÌýJE, Ìýet al. ÌýPharmacy naloxone codispensing: A mixed methods study of practices and perspectives under a statewide standing order program.Ìý ÌýJ Am Pharm Assoc (2003). 2022;62(5):1546-1554. doi:
21.
The Commonwealth of Massachusetts Executive Office of Health and Human Services. Policy No. 2018-04: naloxone dispensing via standing order. Accessed December 10, 2022.
22.
Green ÌýTC, Bratberg ÌýJ, Baird ÌýJ, Ìýet al. ÌýRurality and differences in pharmacy characteristics and community factors associated with provision of naloxone in the pharmacy.Ìý ÌýInt J Drug Policy. 2020;85:102602. doi:
23.
Green ÌýTC, Davis ÌýC, Xuan ÌýZ, Walley ÌýAY, Bratberg ÌýJ. ÌýLaws mandating coprescription of naloxone and their impact on naloxone prescription in five US states, 2014-2018.Ìý ÌýAm J Public Health. 2020;110(6):881-887. doi:
24.
Chatterjee ÌýA, Yan ÌýS, Xuan ÌýZ, Ìýet al. ÌýBroadening access to naloxone: Community predictors of standing order naloxone distribution in Massachusetts.Ìý ÌýDrug Alcohol Depend. 2022;230:109190. doi:
25.
US Census Bureau. American Community Survey 5-year data (2009-2021). Accessed November 1, 2022.
26.
Li ÌýY, Hyder ÌýA, Southerland ÌýLT, Hammond ÌýG, Porr ÌýA, Miller ÌýHJ. Ìý311 Service requests as indicators of neighborhood distress and opioid use disorder.Ìý ÌýSci Rep. 2020;10(1):19579. doi:
27.
Binswanger ÌýIA, Stern ÌýMF, Deyo ÌýRA, Ìýet al. ÌýRelease from prison—a high risk of death for former inmates.Ìý ÌýN Engl J Med. 2007;356(2):157-165. doi:
28.
Gladden ÌýRM, O’Donnell ÌýJ, Mattson ÌýCL, Seth ÌýP. ÌýChanges in opioid-involved overdose deaths by opioid type and presence of benzodiazepines, cocaine, and methamphetamine—25 states, July-December 2017 to January-June 2018.Ìý ÌýMMWR Morb Mortal Wkly Rep. 2019;68(34):737-744. doi:
29.
Soumerai ÌýSB, Ross-Degnan ÌýD, Gortmaker ÌýS, Avorn ÌýJ. ÌýWithdrawing payment for nonscientific drug therapy. Intended and unexpected effects of a large-scale natural experiment.Ìý Ìý´³´¡²Ñ´¡. 1990;263(6):831-839. doi:
30.
Wagner ÌýAK, Soumerai ÌýSB, Zhang ÌýF, Ross-Degnan ÌýD. ÌýSegmented regression analysis of interrupted time series studies in medication use research.Ìý ÌýJ Clin Pharm Ther. 2002;27(4):299-309. doi:
31.
Kuhn ÌýL, Davidson ÌýLL, Durkin ÌýMS. ÌýUse of Poisson regression and time series analysis for detecting changes over time in rates of child injury following a prevention program.Ìý ÌýAm J Epidemiol. 1994;140(10):943-955. doi:
32.
Pan ÌýW. ÌýAkaike’s information criterion in generalized estimating equations.Ìý Ìýµþ¾±´Ç³¾±ð³Ù°ù¾±³¦²õ. 2001;57(1):120-125. doi:
33.
Dimick ÌýJB, Ryan ÌýAM. ÌýMethods for evaluating changes in health care policy: the difference-in-differences approach.Ìý Ìý´³´¡²Ñ´¡. 2014;312(22):2401-2402. doi:
34.
Peters ÌýBG, Tarpey ÌýM. ÌýAre wicked problems really so wicked: perceptions of policy problems.Ìý ÌýPolicy Soc. 2019;38(2):218-236. doi:
35.
Green ÌýTC, Case ÌýP, Fiske ÌýH, Ìýet al. ÌýPerpetuating stigma or reducing risk? Perspectives from naloxone consumers and pharmacists on pharmacy-based naloxone in 2 states.Ìý ÌýJ Am Pharm Assoc (2003). 2017;57(2S):S19-S27, 27.e4. doi:
36.
Burstein ÌýD, Baird ÌýJ, Bratberg ÌýJ, Ìýet al. ÌýPharmacist attitudes toward pharmacy-based naloxone: a cross-sectional survey study.Ìý ÌýJ Am Pharm Assoc (2003). 2020;60(2):304-310. doi:
37.
Donovan ÌýE, Bratberg ÌýJ, Baird ÌýJ, Ìýet al. ÌýPharmacy leaders’ beliefs about how pharmacies can support a sustainable approach to providing naloxone to the community.Ìý ÌýRes Social Adm Pharm. 2020;16(10):1493-1497. doi:
38.
Donovan ÌýE, Case ÌýP, Bratberg ÌýJP, Ìýet al. ÌýBeliefs associated with pharmacy-based naloxone: a qualitative study of pharmacy-based naloxone purchasers and people at risk for opioid overdose.Ìý ÌýJ Urban Health. 2019;96(3):367-378. doi:
39.
Green ÌýTC, Donovan ÌýE, Klug ÌýB, Ìýet al. ÌýRevisiting pharmacy-based naloxone with pharmacists and naloxone consumers in 2 states: 2017 perspectives and evolving approaches.Ìý ÌýJ Am Pharm Assoc (2003). 2020;60(5):740-749. doi:
40.
Green ÌýTC, Soipe ÌýA, Baloy ÌýB, Ìýet al. ÌýPharmacy on-site overdose protocols and prevention of overdose.Ìý ÌýSubst Abus. 2022;43(1):64-68. doi:
41.
Green ÌýTC, Bratberg ÌýJ, Irwin ÌýAN, Ìýet al. ÌýStudy protocol for the Respond to Prevent Study: a multi-state randomized controlled trial to improve provision of naloxone, buprenorphine and nonprescription syringes in community pharmacies.Ìý ÌýSubst Abus. 2022;43(1):901-905. doi:
42.
Altekruse ÌýSF, Cosgrove ÌýCM, Altekruse ÌýWC, Jenkins ÌýRA, Blanco ÌýC. ÌýSocioeconomic risk factors for fatal opioid overdoses in the United States: findings from the Mortality Disparities in American Communities Study (MDAC).Ìý ÌýPLoS One. 2020;15(1):e0227966. doi:
43.
Chatterjee ÌýA, Yan ÌýS, Lambert ÌýA, Ìýet al. ÌýComparison of a national commercial pharmacy naloxone data source to state and city pharmacy naloxone data sources—Rhode Island, Massachusetts, and New York City, 2013-2019.Ìý ÌýHealth Serv Res. 2023;58(5):1141-1150. doi:
44.
Heiman ÌýE, Lanh ÌýS, Moran ÌýTP, Steck ÌýA, Carpenter ÌýJ. ÌýElectronic Advisories Increase Naloxone Prescribing Across Health Care Settings.Ìý ÌýJ Gen Intern Med. 2023;38(6):1402-1409. doi:
45.
Sohn ÌýM, Talbert ÌýJC, Huang ÌýZ, Lofwall ÌýMR, Freeman ÌýPR. ÌýAssociation of naloxone coprescription laws with naloxone prescription dispensing in the United States.Ìý Ìý´³´¡²Ñ´¡ Netw Open. 2019;2(6):e196215. doi:
46.
Doe-Simkins ÌýM, Quinn ÌýE, Xuan ÌýZ, Ìýet al. ÌýOverdose rescues by trained and untrained participants and change in opioid use among substance-using participants in overdose education and naloxone distribution programs: a retrospective cohort study.Ìý ÌýBMC Public Health. 2014;14:297. doi:
47.
Jones ÌýJD, Campbell ÌýA, Metz ÌýVE, Comer ÌýSD. ÌýNo evidence of compensatory drug use risk behavior among heroin users after receiving take-home naloxone.Ìý ÌýAddict Behav. 2017;71:104-106. doi:
48.
Tse ÌýWC, Djordjevic ÌýF, Borja ÌýV, Ìýet al. ÌýDoes naloxone provision lead to increased substance use: a systematic review to assess if there is evidence of a ‘moral hazard’ associated with naloxone supply.Ìý ÌýInt J Drug Policy. 2022;100:103513. doi:
×