Model Testing Matrix

Test XMLLM's compliance across different models, schemas, and strategies

Test Cases
Qwen 2.5 7B Turbo
$/$Default XMLLM
Ministral 8B
$/$Default XMLLM

Simple Name Generation

Generate a single dog name - testing basic string output

Not tested
Not tested

Simple List Generation

Generate a basic list of items with attributes

Not tested
Not tested

Nested Content Analysis

Complex nested structure with multiple data types

Not tested
Not tested

Structured Profile Generation

Generate detailed profile with specific constraints

Not tested
Not tested

Event Timeline

Generate a sequence of events with temporal relationships

Not tested
Not tested

Recursive Menu Structure

Generate a nested menu structure with recursive items - tests handling of self-referential schemas and price hierarchy (items in subcategories must cost at least as much as their parent category base price)

Not tested
Not tested

Conditional Field Requirements

Generate data where certain fields are required based on other field values

Not tested
Not tested