.Nature Medication, Posted online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although huge foreign language designs (LLMs) show guarantee in regulated settings, a research now reveals their constraints in real-world medical requests and also points the way in the direction of sturdy assessment and benchmarking prior to clinical use.