Model Testing Matrix

Test XMLLM's compliance across different models, schemas, and strategies

Strategy
Hints
Parser:
Strategy
Hints
Parser:
Test Cases
Qwen 2.5 7B Turbo + XML
$/$Default XMLLMXML
Ministral 8B + XML
$/$Default XMLLMXML

Simple Name Generation

Generate a single dog name - testing basic string output

No results
No results

Simple List Generation

Generate a basic list of items with attributes

No results
No results

Nested Content Analysis

Complex nested structure with multiple data types

No results
No results

Structured Profile Generation

Generate detailed profile with specific constraints

No results
No results

Event Timeline

Generate a sequence of events with temporal relationships

No results
No results

Recursive Menu Structure

Generate a nested menu structure with recursive items - tests handling of self-referential schemas and price hierarchy (items in subcategories must cost at least as much as their parent category base price)

No results
No results

Conditional Field Requirements

Generate data where certain fields are required based on other field values

No results
No results

Blog Post Generation

Generate three short blog posts about apples with different tones (professional, casual, humorous)

No results
No results

Array Operations

Test array-level transformations and validation with types.items()

No results
No results

Nested Items Structure

Test deeply nested types.items() with complex transformations

No results
No results

CDATA Content Handling

Test raw type with CDATA content preservation

No results
No results