Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries
Paper
•
2310.13132
•
Published
•
8
Med AI Papers
Note 📰 SDoH from EHR https://www.nature.com/articles/s41746-023-00970-0 📰 Intervention of MH crisis https://www.nature.com/articles/s41746-023-00951-3 📰 EHR Safety https://kffhealthnews.org/news/death-by-a-thousand-clicks/ 🔖 Codes https://huggingface.co/collections/awacke1/ultimate-clinical-terminology-mle-datasets-65b99b3dca1d5f670fae106a 👷♂️Dataset: https://github.com/CogStack/OpenGPT
Do We Still Need Clinical Language Models?
Paper • 2302.08091 • Published • 3Note 💫 Do we need finetuned specialized clinical models? (older) 💫 From Trunk to Tail: Navigating the Complexities of Generative AI in Healthcare https://pubs.rsna.org/doi/10.1148/radiol.240935 (as of May 21, 2024)
Advancing Multimodal Medical Capabilities of Gemini
Paper • 2405.03162 • Published • 2Note Med-Gemini (USMLE - 91.1%) 💫 https://research.google/blog/advancing-medical-ai-with-med-gemini/
-
The impact of using an AI chatbot to respond to patient messages
Paper • 2310.17703 • Published • 5 -
Clinical Camel: An Open-Source Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding
Paper • 2305.12031 • Published • 5 -
ChatDoctor: A Medical Chat Model Fine-tuned on LLaMA Model using Medical Domain Knowledge
Paper • 2303.14070 • Published • 10 -
Large language models in medicine: the potentials and pitfalls
Paper • 2309.00087 • Published • 3 -
The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRs
Paper • 2303.12961 • Published • 3 -
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day
Paper • 2306.00890 • Published • 11 -
Towards Generalist Biomedical AI
Paper • 2307.14334 • Published • 13
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
Paper • 2402.10373 • Published • 9Note 🔖Model: https://huggingface.co/BioMistral/BioMistral-7B 🔖Dataset(s): https://huggingface.co/datasets/BioMistral/BioInstructQA
-
EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Models
Paper • 2307.02028 • Published • 3 -
Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare delivery
Paper • 2304.13714 • Published • 1 -
Exploring the Effectiveness of Instruction Tuning in Biomedical Language Processing
Paper • 2401.00579 • Published • 2
Towards Conversational Diagnostic AI
Paper • 2401.05654 • Published • 20Note 1. "We introduce an LLM based AI system optimized for diagnostic dialogue." 2. "We compared its performance to that of primary care physicians (PCPs) in a randomized, double-blind crossover study." 3. "The LLM demonstrated greater diagnostic accuracy and superior performance on 28 of 32 axes according to specialist physicians and 24 of 26 axes according to patient actors."
-
Benchmarking Retrieval-Augmented Generation for Medicine
Paper • 2402.13178 • Published • 8 -
StanfordShahLab/clmbr-t-base
0.1B • Updated • 1.1k • 71 -
nlpie/Llama2-MedTuned-Instructions
Viewer • Updated • 270k • 80 • 42 -
nlpie/Llama2-MedTuned-7b
Text Generation • Updated • 31 • 11 -
katielink/expertqa_medical
Viewer • Updated • 458 • 30 -
katielink/nejm-medqa-diagnostic-reasoning-dataset
Viewer • Updated • 910 • 181 • 5 -
AGBonnet/augmented-clinical-notes
Viewer • Updated • 30k • 1.41k • 58 -
RoentGen: Vision-Language Foundation Model for Chest X-ray Generation
Paper • 2211.12737 • Published • 2 -
CheXagent: Towards a Foundation Model for Chest X-Ray Interpretation
Paper • 2401.12208 • Published • 22 -
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text
Paper • 2403.18421 • Published • 23
431Open Medical-LLM Leaderboard
🥇Explore and submit models for benchmarking
Note Eval 1: https://huggingface.co/blog/mpimentel/comparing-llms-medical-ai