Phase II year
2019
(last award dollars: 2020)
Phase II Amount
$1,082,111
Millions of Americans receive evidence-based counseling for substance use problems each year. Many evidence-based treatments for substance abuse are talk based therapies, such as motivational interviewing (MI), but the existing research-based methodology for evaluating counseling quality is to record sessions and use human rating teams to evaluate them. However, using humans as the assessment tool via behavioral coding is prohibitive in cost and time, can be error prone, and is virtually never used in the real world. Technology is needed that can analyze the speech patterns and spoken language of counseling sessions, provide automatic and intuitive quality scores, and summarize these in actionable feedback. Rapid, performance-based quality metrics could support training, ongoing supervision, and quality assurance for millions of evidence-based counseling sessions for substance abuse each year. Lyssn.io is a start-up targeting the development of implementation-focused technology to support evidence-based counseling. Our goal is to develop innovative health technology solutions that are objective, scalable, and cost efficient. Lyssn.io includes expertise in speech signal processing, machine learning, user-centered design, software engineering, and clinical expertise in evidence-based counseling. Previous NIH-funded research laid a computational foundation for generating MI quality metrics from speech and language features in MI sessions, and led to a prototype of a clinical software support tool, the Counselor Observer Ratings Expert for MI (CORE-MI). The current Fast-Track SBIR proposal includes Phase I, which will focus on understanding clinical workflows, assessing usability, and initial validation of machine learning of MI fidelity measures in the opioid treatment program at Evergreen Treatment Services (ETS) clinic in Seattle, WA. Phase II will focus on robust validation of the speech and language technologies underlying the CORE-MI tool, and development of scalable supervision protocols that integrate CORE-MI supported feedback for counselors. Finally, we will conduct a quasi-experimental evaluation of CORE-MI supported supervision and training at a second ETS clinic in the Puget Sound, focusing on acceptability, usability, and adoption, the impact on supervision, improved MI fidelity and preliminary evidence of increased client retention. The successful execution of this project will break the reliance on human judgment for providing performance-based feedback to MI and will massively expand the capacity to train, supervise, and provide quality assurance in MI for substance abuse.
Public Health Relevance Statement: Most evidence-based treatments for substance abuse are in-person psychotherapy and counseling interventions, such as motivational interviewing. There are currently no methods for evaluating the quality of such counseling interventions in the real world to support training, supervision, and quality assurance. Building on an existing prototype, Lyssn.io a technology start-up focused on scalable and cost-efficient human-centered technologies will enhance and evaluate a cloud-based, HIPAA-compliant clinical support software tool that uses automated speech recognition and machine learning in an community based opioid replacement clinic.
NIH Spending Category: Behavioral and Social Science; Bioengineering; Brain Disorders; Clinical Research; Drug Abuse (NIDA only); Machine Learning and Artificial Intelligence; Networking and Information Technology R&D (NITRD); Opioid Misuse and Addiction; Opioids; Substance Abuse
Project Terms: addiction; Adherence; Administrator; Adoption; Alcohol or Other Drugs use; Algorithms; American; Assessment tool; automated speech recognition; automobile accident; base; Behavior Therapy; Behavioral; Benchmarking; Client; Clinic; Clinical; clinical practice; cloud based; Code; Communities; community setting; Computer software; Consumption; cost; cost efficient; Counseling; dashboard; Dependence; design; Development; E-learning; Enhancement Technology; Environment; Evaluation; evidence base; Evidence based treatment; experience; Feasibility Studies; Feedback; Foundations; Funding; Goals; gun homicide; Health Insurance Portability and Accountability Act; Health Technology; Human; implementation research; improved; innovation; Intervention; Intuition; Judgment; Language; Learning; Machine Learning; Measurement; Measures; Methodology; Methods; Mission; motivational enhancement therapy; National Institute of Drug Abuse; Needs Assessment; novel; Online Systems; Opioid; opioid abuse; opioid treatment program; Outcome; overdose death; Pattern; Performance; Persons; Pharmaceutical Preparations; Phase; prediction algorithm; Process; Professional counselor; protocol development; Protocols documentation; prototype; Provider; Psychology; Psychotherapy; quality assurance; Reporting; Research; research and development; Research Personnel; Resources; signal processing; Site; skills; Small Business Innovation Research Grant; Software Engineering; Software Tools; sound; Speech; speech processing; Stream; Substance abuse problem; substance abuse treatment; Substance Use Disorder; Suicide; Supervision; support tools; System; technological innovation; Technology; Testing; Time; tool; tool development; Training; Training Support; treatment services; United States National Institutes of Health; Universities; Update; usability; user centered design; Utah; Validation; virtual; visual feedback; Work
