Millions of Americans are in need of evidence-based counseling, such as motivational interviewing (MI), for alcohol use disorders (AUDs) each year. To develop competence in an evidence-based practice like MI, trainees require ample opportunities for practice and immediate, performance-based feedback on the skills that they are learning. However, this is challenging if not impossible to offer at scale -- to the large number of providers in need of training. Opportunities for practice typically rely on roleplays with other trainees with limited experience, and feedback requires either direct supervision from an expert trainer or behavioral coding from a trained coding team; these are costly, limited, and time consuming. AI-based technology can meet this need, generating many opportunities for practice, and providing regular, actionable feedback. Many practice opportunities coupled with rapid, performance-based feedback can enhance and expand training in evidence-based counseling for AUDs in a scalable and cost-efficient manner. Lyssn.io?, Inc., (Lyssn) is a start-up developing AI-based technologies to support training, supervision, and quality assurance of evidence-based counseling. Our goal is to develop innovative health technology solutions that are objective, scalable, and cost efficient. ?Lyssns? team includes expertise in natural language processing, machine learning, user-centered design, software engineering, and clinical expertise in evidence-based counseling. Previous research demonstrated the basic utility of a prototype conversational agent (ClientBot) for training counselors. Currently, ClientBot simulates a general mental health client who can engage in open-ended interaction with trainees and provides immediate, performance-based feedback to trainees using machine learning. The current Fast-Track SBIR proposal partners ?Lyssn? with Prevention Research Institute (PRI), who has a long track-record of training counselors in evidence-based approaches for AUD and currently trains approximately 1,250 counselors per year. Phase I will adapt ClientBot to an AUD training context, including understanding PRI training workflows, assessing usability, and accuracy of machine learning based MI feedback. Phase II will conduct a field-based usability trial and a randomized training trial (N = 200 PRI trainees) to evaluate the effectiveness of ClientBot on learning of MI skills compared to a wait-list and PRI training-as-usual. Analyses will also examine the hypothesized mechanisms of behavior change underlying ClientBots MI skills training. The successful execution of this project will break the reliance on role plays with peers and human judgment for training and performance-based feedback and support commercialization of a ClientBot product for training of AUD counselors in evidence-based practices.
Public Health Relevance Statement: PROJECT NARRATIVE Training counselors in evidence-based treatments for alcohol use disorders (AUDs) requires repeated opportunities for skills practice with performance-based feedback, which is challenging to provide at scale. Building on an existing prototype, ?Lyssn.io? a technology start-up focused on scalable and cost-efficient human-centered technologies will enhance and evaluate an AI-based, conversational agent (ClientBot) that simulates a realistic client with alcohol concerns and provides performance-based feedback to support counselor training.
Project Terms: Alcohol consumption; Alcohol or Other Drugs use; alcohol testing; alcohol use disorder; Alcohols; American; Assessment tool; base; behavior change; Behavioral; behavioral health; Behavioral Mechanisms; Client; Clinical; Code; commercialization; Competence; Consumption; Control Groups; cost; cost efficient; Counseling; Coupled; design; Development; Effectiveness; effectiveness evaluation; Environment; Evaluation; evidence base; Evidence based practice; Evidence based treatment; experience; experimental study; Feedback; Goals; Health Personnel; Health Technology; Human; improved; Individual; innovation; Interview; Judgment; Learning; Learning Skill; Machine Learning; member; Mental Health; Modeling; motivational enhancement therapy; Music; National Institute on Alcohol Abuse and Alcoholism; Natural Language Processing; Nonprofit Organizations; Operative Surgical Procedures; Outcome; Participant; Patients; peer; Performance; Persons; Phase; Play; Prevention Research; Professional counselor; prototype; Provider; quality assurance; Randomized; Recovery; Research; Research Institute; Role; scale up; skill acquisition; skills; skills training; Small Business Innovation Research Grant; Software Engineering; Sports; Strategic Planning; Structure; Substance abuse problem; Supervision; System; Technology; Testing; Text; Thinking; Time; tool; Training; Training Activity; Training Support; treatment choice; usability; user centered design; Vision; Waiting Lists; Work
