PsychiatryBench: a multi-task benchmark for LLMs in psychiatry.

We evaluate a diverse set of frontier large language models (including Google Gemini, DeepSeek, Sonnet 4.5, and GPT 5) alongside leading open-source medical models such as MedGemma using both conventional metrics and an "large language models-as-judge" similarity scoring framework.