Update attention_unet/leverage_summary.txt
Browse files
attention_unet/leverage_summary.txt
CHANGED
|
@@ -7,8 +7,8 @@
|
|
| 7 |
|
| 8 |
DATASET INFORMATION:
|
| 9 |
--------------------
|
| 10 |
-
Training Images:
|
| 11 |
-
Test Images:
|
| 12 |
Image Size: (256, 256)
|
| 13 |
Classes: Background (0), Normal WMH (1), Abnormal WMH (2)
|
| 14 |
|
|
@@ -24,25 +24,14 @@
|
|
| 24 |
|
| 25 |
PERFORMANCE RESULTS:
|
| 26 |
--------------------
|
| 27 |
-
|
| 28 |
-
| Scenario 1 (Binary) | Scenario 2 (3-class) | Improvement
|
| 29 |
--------------------|---------------------|----------------------|------------
|
| 30 |
Accuracy | 0.9844 | 0.9959 | +0.0115
|
| 31 |
Precision | 0.3236 | 0.7110 | +0.3874
|
| 32 |
Recall | 0.9769 | 0.7707 | -0.2062
|
| 33 |
-
Specificity | 0.9998 | 0.9983 | -0.0016
|
| 34 |
Dice Coefficient | 0.4861 | 0.7396 | +0.2535
|
| 35 |
IoU Coefficient | 0.3211 | 0.5868 | +0.2657
|
| 36 |
|
| 37 |
-
SURFACE-BASED METRICS (lower is better):
|
| 38 |
-
| Scenario 1 (Binary) | Scenario 2 (3-class) | Improvement
|
| 39 |
-
--------------------|---------------------|----------------------|------------
|
| 40 |
-
HD95 (pixels) | 52.3479 ± 41.1076 | 47.0514 ± 40.1375 | +5.2965
|
| 41 |
-
ASSD (pixels) | 11.1905 ± 12.0022 | 14.1671 ± 18.8798 | -2.9767
|
| 42 |
-
|
| 43 |
-
Note: For HD95 and ASSD, positive improvement means reduction (better boundary accuracy)
|
| 44 |
-
Valid samples: HD95=128/161, ASSD=128/161
|
| 45 |
-
|
| 46 |
STATISTICAL SIGNIFICANCE:
|
| 47 |
-------------------------
|
| 48 |
DICE COEFFICIENT:
|
|
@@ -61,56 +50,11 @@
|
|
| 61 |
95% Confidence Interval: [0.0961, 0.1786]
|
| 62 |
Result: SIGNIFICANT improvement
|
| 63 |
|
| 64 |
-
HD95 (95th Percentile Hausdorff Distance):
|
| 65 |
-
Test: Paired t-test
|
| 66 |
-
t-statistic: 1.7275
|
| 67 |
-
p-value: 0.0865
|
| 68 |
-
Effect Size (Cohen's d): 0.1299
|
| 69 |
-
95% Confidence Interval: [-0.7706, 11.3635] pixels
|
| 70 |
-
Result: NOT SIGNIFICANT improvement
|
| 71 |
-
|
| 72 |
-
ASSD (Average Symmetric Surface Distance):
|
| 73 |
-
Test: Paired t-test
|
| 74 |
-
t-statistic: -2.6433
|
| 75 |
-
p-value: 0.0092
|
| 76 |
-
Effect Size (Cohen's d): -0.1874
|
| 77 |
-
95% Confidence Interval: [-5.2051, -0.7482] pixels
|
| 78 |
-
Result: SIGNIFICANT improvement
|
| 79 |
-
|
| 80 |
KEY FINDINGS:
|
| 81 |
-------------
|
| 82 |
-
OVERLAP-BASED METRICS:
|
| 83 |
1. Three-class segmentation shows 43.87% improvement in Dice coefficient
|
| 84 |
2. Three-class segmentation shows 63.30% improvement in IoU coefficient
|
| 85 |
3. Dice improvement is statistically significant (p<0.05)
|
| 86 |
4. IoU improvement is statistically significant (p<0.05)
|
| 87 |
-
|
| 88 |
-
SURFACE-BASED METRICS:
|
| 89 |
-
5. HD95 shows 10.12% reduction (lower is better)
|
| 90 |
-
6. ASSD shows 26.60% increase (lower is better)
|
| 91 |
-
7. HD95 improvement is not statistically significant
|
| 92 |
-
8. ASSD improvement is statistically significant (p<0.05)
|
| 93 |
-
|
| 94 |
-
OVERALL ASSESSMENT:
|
| 95 |
-
9. Post-processing provided substantial improvements in both scenarios
|
| 96 |
-
10. Three-class approach shows consistent advantages across multiple metrics
|
| 97 |
-
11. Boundary accuracy (HD95/ASSD) improved significantly
|
| 98 |
-
|
| 99 |
-
FILES GENERATED:
|
| 100 |
-
----------------
|
| 101 |
-
- Models: scenario1_binary_model.h5, scenario2_multiclass_model.h5
|
| 102 |
-
- Figures: training_curves.png/.pdf, comparison_visualization.png/.pdf, metrics_comparison.png/.pdf
|
| 103 |
-
- Tables: comprehensive_results.csv/.xlsx, surface_metrics.csv/.xlsx, latex_table.tex, latex_surface_table.tex
|
| 104 |
-
- Statistics: statistical_analysis.json, statistical_report.txt
|
| 105 |
-
- Predictions: All test predictions and ground truth data saved
|
| 106 |
-
|
| 107 |
-
PUBLICATION READINESS:
|
| 108 |
-
----------------------
|
| 109 |
-
✓ High-resolution figures (300 DPI, PNG/PDF)
|
| 110 |
-
✓ LaTeX-formatted tables (overlap and surface metrics)
|
| 111 |
-
✓ Comprehensive statistical analysis (Dice, IoU, HD95, ASSD)
|
| 112 |
-
✓ Post-processing impact analysis
|
| 113 |
-
✓ Reproducible results with saved models
|
| 114 |
-
✓ Professional documentation
|
| 115 |
-
✓ Surface-based metrics for boundary accuracy assessment
|
| 116 |
|
|
|
|
| 7 |
|
| 8 |
DATASET INFORMATION:
|
| 9 |
--------------------
|
| 10 |
+
Training Images: 2050
|
| 11 |
+
Test Images: 350
|
| 12 |
Image Size: (256, 256)
|
| 13 |
Classes: Background (0), Normal WMH (1), Abnormal WMH (2)
|
| 14 |
|
|
|
|
| 24 |
|
| 25 |
PERFORMANCE RESULTS:
|
| 26 |
--------------------
|
| 27 |
+
| Scenario 1 (Binary) | Scenario 2 (3-class) | Improvement
|
|
|
|
| 28 |
--------------------|---------------------|----------------------|------------
|
| 29 |
Accuracy | 0.9844 | 0.9959 | +0.0115
|
| 30 |
Precision | 0.3236 | 0.7110 | +0.3874
|
| 31 |
Recall | 0.9769 | 0.7707 | -0.2062
|
|
|
|
| 32 |
Dice Coefficient | 0.4861 | 0.7396 | +0.2535
|
| 33 |
IoU Coefficient | 0.3211 | 0.5868 | +0.2657
|
| 34 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
STATISTICAL SIGNIFICANCE:
|
| 36 |
-------------------------
|
| 37 |
DICE COEFFICIENT:
|
|
|
|
| 50 |
95% Confidence Interval: [0.0961, 0.1786]
|
| 51 |
Result: SIGNIFICANT improvement
|
| 52 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
KEY FINDINGS:
|
| 54 |
-------------
|
|
|
|
| 55 |
1. Three-class segmentation shows 43.87% improvement in Dice coefficient
|
| 56 |
2. Three-class segmentation shows 63.30% improvement in IoU coefficient
|
| 57 |
3. Dice improvement is statistically significant (p<0.05)
|
| 58 |
4. IoU improvement is statistically significant (p<0.05)
|
| 59 |
+
5. Post-processing provided substantial improvements in both scenarios
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
|