Character Personality Expression Through Language Style

Aion-RP-Llama-3.1-8B ranks the highest in the character evaluation portion of the RPBench-Auto benchmark, a roleplaying-specific variant of Arena-Hard-Auto, where LLMs evaluate each other’s responses. It is a fine-tuned base model...

Unique: Trained on roleplay datasets where personality expression through language style is a primary evaluation metric, learning implicit associations between character traits and linguistic patterns

vs others: Better at expressing personality through natural language variation than base models because fine-tuning teaches it to map character traits to specific vocabulary and speech pattern choices