Bawil commited on
Commit
ab8e6fe
·
verified ·
1 Parent(s): 7a2b304

Update attention_unet/leverage_summary.txt

Browse files
Files changed (1) hide show
  1. attention_unet/leverage_summary.txt +4 -60
attention_unet/leverage_summary.txt CHANGED
@@ -7,8 +7,8 @@
7
 
8
  DATASET INFORMATION:
9
  --------------------
10
- Training Images: 1044
11
- Test Images: 161
12
  Image Size: (256, 256)
13
  Classes: Background (0), Normal WMH (1), Abnormal WMH (2)
14
 
@@ -24,25 +24,14 @@
24
 
25
  PERFORMANCE RESULTS:
26
  --------------------
27
- OVERLAP-BASED METRICS:
28
- | Scenario 1 (Binary) | Scenario 2 (3-class) | Improvement
29
  --------------------|---------------------|----------------------|------------
30
  Accuracy | 0.9844 | 0.9959 | +0.0115
31
  Precision | 0.3236 | 0.7110 | +0.3874
32
  Recall | 0.9769 | 0.7707 | -0.2062
33
- Specificity | 0.9998 | 0.9983 | -0.0016
34
  Dice Coefficient | 0.4861 | 0.7396 | +0.2535
35
  IoU Coefficient | 0.3211 | 0.5868 | +0.2657
36
 
37
- SURFACE-BASED METRICS (lower is better):
38
- | Scenario 1 (Binary) | Scenario 2 (3-class) | Improvement
39
- --------------------|---------------------|----------------------|------------
40
- HD95 (pixels) | 52.3479 ± 41.1076 | 47.0514 ± 40.1375 | +5.2965
41
- ASSD (pixels) | 11.1905 ± 12.0022 | 14.1671 ± 18.8798 | -2.9767
42
-
43
- Note: For HD95 and ASSD, positive improvement means reduction (better boundary accuracy)
44
- Valid samples: HD95=128/161, ASSD=128/161
45
-
46
  STATISTICAL SIGNIFICANCE:
47
  -------------------------
48
  DICE COEFFICIENT:
@@ -61,56 +50,11 @@
61
  95% Confidence Interval: [0.0961, 0.1786]
62
  Result: SIGNIFICANT improvement
63
 
64
- HD95 (95th Percentile Hausdorff Distance):
65
- Test: Paired t-test
66
- t-statistic: 1.7275
67
- p-value: 0.0865
68
- Effect Size (Cohen's d): 0.1299
69
- 95% Confidence Interval: [-0.7706, 11.3635] pixels
70
- Result: NOT SIGNIFICANT improvement
71
-
72
- ASSD (Average Symmetric Surface Distance):
73
- Test: Paired t-test
74
- t-statistic: -2.6433
75
- p-value: 0.0092
76
- Effect Size (Cohen's d): -0.1874
77
- 95% Confidence Interval: [-5.2051, -0.7482] pixels
78
- Result: SIGNIFICANT improvement
79
-
80
  KEY FINDINGS:
81
  -------------
82
- OVERLAP-BASED METRICS:
83
  1. Three-class segmentation shows 43.87% improvement in Dice coefficient
84
  2. Three-class segmentation shows 63.30% improvement in IoU coefficient
85
  3. Dice improvement is statistically significant (p<0.05)
86
  4. IoU improvement is statistically significant (p<0.05)
87
-
88
- SURFACE-BASED METRICS:
89
- 5. HD95 shows 10.12% reduction (lower is better)
90
- 6. ASSD shows 26.60% increase (lower is better)
91
- 7. HD95 improvement is not statistically significant
92
- 8. ASSD improvement is statistically significant (p<0.05)
93
-
94
- OVERALL ASSESSMENT:
95
- 9. Post-processing provided substantial improvements in both scenarios
96
- 10. Three-class approach shows consistent advantages across multiple metrics
97
- 11. Boundary accuracy (HD95/ASSD) improved significantly
98
-
99
- FILES GENERATED:
100
- ----------------
101
- - Models: scenario1_binary_model.h5, scenario2_multiclass_model.h5
102
- - Figures: training_curves.png/.pdf, comparison_visualization.png/.pdf, metrics_comparison.png/.pdf
103
- - Tables: comprehensive_results.csv/.xlsx, surface_metrics.csv/.xlsx, latex_table.tex, latex_surface_table.tex
104
- - Statistics: statistical_analysis.json, statistical_report.txt
105
- - Predictions: All test predictions and ground truth data saved
106
-
107
- PUBLICATION READINESS:
108
- ----------------------
109
- ✓ High-resolution figures (300 DPI, PNG/PDF)
110
- ✓ LaTeX-formatted tables (overlap and surface metrics)
111
- ✓ Comprehensive statistical analysis (Dice, IoU, HD95, ASSD)
112
- ✓ Post-processing impact analysis
113
- ✓ Reproducible results with saved models
114
- ✓ Professional documentation
115
- ✓ Surface-based metrics for boundary accuracy assessment
116
 
 
7
 
8
  DATASET INFORMATION:
9
  --------------------
10
+ Training Images: 2050
11
+ Test Images: 350
12
  Image Size: (256, 256)
13
  Classes: Background (0), Normal WMH (1), Abnormal WMH (2)
14
 
 
24
 
25
  PERFORMANCE RESULTS:
26
  --------------------
27
+ | Scenario 1 (Binary) | Scenario 2 (3-class) | Improvement
 
28
  --------------------|---------------------|----------------------|------------
29
  Accuracy | 0.9844 | 0.9959 | +0.0115
30
  Precision | 0.3236 | 0.7110 | +0.3874
31
  Recall | 0.9769 | 0.7707 | -0.2062
 
32
  Dice Coefficient | 0.4861 | 0.7396 | +0.2535
33
  IoU Coefficient | 0.3211 | 0.5868 | +0.2657
34
 
 
 
 
 
 
 
 
 
 
35
  STATISTICAL SIGNIFICANCE:
36
  -------------------------
37
  DICE COEFFICIENT:
 
50
  95% Confidence Interval: [0.0961, 0.1786]
51
  Result: SIGNIFICANT improvement
52
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
  KEY FINDINGS:
54
  -------------
 
55
  1. Three-class segmentation shows 43.87% improvement in Dice coefficient
56
  2. Three-class segmentation shows 63.30% improvement in IoU coefficient
57
  3. Dice improvement is statistically significant (p<0.05)
58
  4. IoU improvement is statistically significant (p<0.05)
59
+ 5. Post-processing provided substantial improvements in both scenarios
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60