Multilingual Clinical Knowledge Assessment Across English And Chinese Variants

via “multilingual safety evaluation dataset with category-stratified sampling”

11K safety evaluation questions across 7 categories.

Unique: Provides parallel Chinese-English safety evaluation with 7-category stratification and category-balanced few-shot examples (5 per category), enabling contrastive safety analysis across languages and fine-grained failure mode diagnosis. Most safety benchmarks (e.g., TruthfulQA, HarmBench) focus on English only or lack structured category decomposition.

vs others: Uniquely covers both Chinese and English with identical category structure, enabling cross-lingual safety parity validation that general-purpose benchmarks like MMLU cannot provide; category-stratified design reveals which safety domains models struggle with rather than aggregate safety scores.

12.7K USMLE medical exam questions for clinical AI evaluation.

Unique: Includes validated multilingual variants (English, simplified Chinese, traditional Chinese) of USMLE questions, enabling direct cross-lingual evaluation of clinical knowledge; most medical QA datasets are English-only, and multilingual medical datasets typically lack the rigor of USMLE-aligned questions

vs others: Enables evaluation of clinical reasoning across languages using the same standardized exam format, whereas other multilingual medical datasets (e.g., PubMedQA) lack language-specific variants or use lower-quality translations without medical validation

via “multilingual code-switching and cross-lingual reasoning”

01.AI's bilingual 34B model with 200K context option.

Unique: Unified bilingual architecture enables natural code-switching and cross-lingual reasoning through shared vocabulary and embedding space, rather than separate language models or post-hoc translation. Allows implicit translation and cross-lingual understanding without explicit translation steps.

vs others: Outperforms separate English and Chinese models on code-switching tasks by eliminating model-switching overhead and enabling cross-lingual reasoning, while avoiding the performance degradation of translation-based approaches.

via “cross-lingual and multilingual embedding compatibility”

feature-extraction model by undefined. 23,40,169 downloads.

Unique: Inherits BERT's shared tokenizer vocabulary enabling token-level understanding of English within Chinese context, but lacks explicit cross-lingual alignment training, resulting in asymmetric performance where Chinese queries retrieve English documents better than vice versa

vs others: Better Chinese-specific performance than true multilingual models (mBERT, XLM-R) at the cost of cross-lingual capability; suitable for Chinese-primary systems with occasional English queries, but not for balanced multilingual retrieval

via “chinese language-specific evaluation with gaokao-level academic assessment”

ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大

Unique: Incorporates Gaokao (Chinese college entrance exam) level questions into evaluation framework, testing academic-level Chinese language understanding and writing quality. Combines general language proficiency assessment with domain-specific language tasks (medical terminology, legal documents, financial reports in Chinese). Uses 1-5 quality scale for response evaluation rather than binary correctness, capturing nuanced language performance.

vs others: Chinese-specific academic assessment vs English-centric benchmarks (MMLU, HELM) and Gaokao-level difficulty calibration vs generic language benchmarks

via “multi-language symptom assessment”

via “multi-language-clinical-support”

via “multilingual conversation support”