FieldBench Alignment Evaluation · 80 Samples · 5 Domains
Empirical Results & Cross-Model Analysis
Source: fieldbench/corpus
Doc Exact Match+16.2%
80.0%peak (higher is better)
Base: 63.8%→SFT v2: 80.0%→DPO: 52.5%
Schema Validity (Strict)+26.2%
100.0%peak (higher is better)
Base: 73.8%→SFT v2: 100.0%→DPO: 66.3%
Field-Level F1+23.7%
95.0%peak (higher is better)
Base: 71.3%→SFT v2: 95.0%→DPO: 62.5%
Hallucination Rate (Adj)-26.3%
0.0%peak (lower is better)
Base: 26.3%→SFT v2: 0.0%→DPO: 33.8%
Standardized Evaluation Results · fieldbench/corpus
Evaluated on test split across 80 document samples in 5 domains
| System / Adapter | parse_ok | schema_valid | field_f1 | doc_exact | null_acc | halluc_rate | halluc_adj |
|---|---|---|---|---|---|---|---|
Base (3.35B) | 73.8% | 73.8% | 71.3% | 63.8% | 73.8% | 0.0% | 26.3% |
SFT v2 Adapter | 100.0% | 100.0% | 95.0% | 80.0% | 100.0% | 0.0% | 0.0% |
DPO Aligned Adapter | 66.3% | 66.3% | 62.5% | 52.5% | 66.3% | 0.0% | 33.8% |
7-Metric Capability Profile
Normalized (%)Geometric Alignment Radar
5 Core DimensionsPer-Domain Breakdown · fieldbench/corpus
Sample-Level Inspector & 3-Model Diff
Click any row to inspect source document, target schema, gold ground truth, and actual predictions
Source Document
Clinical note for Patient-026: prescribed Metformin 250mg daily. Known allergy: Penicillin.
Gold Target JSON
{
"patient_id": "Patient-026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}Model Predictions Side-by-Side
Base8734ms · f1: 0%
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```**Final Fused Generation:**
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```**Final Fused Generation:**
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```**FinalSFT v21681ms · f1: 75%
{"allergy": "Penicillin", "medication": "Metformin", "patient_id": "026", "dosage_mg": 250}DPO16845ms · f1: 0%
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metformin",
"dosage_mg": 250,
"allergy": "Penicillin"
}
```
```json
{
"patient_id": "026",
"medication": "Metform