benchmarks

Baseline quality-of-results prediction-error benchmarks from EDA-Schema-V2 — the error any ML predictor should aim to beat.

Baseline quality-of-results prediction error: using each intermediate design-stage estimate to predict the final detailed-route value, across four open-source PDKs (NG45, SKY130, IHP130, ASAP7).
Metric Floorplan → DR Global place → DR Detailed place → DR CTS → DR Global route → DR
NG45 SKY130 IHP130 ASAP7 NG45 SKY130 IHP130 ASAP7 NG45 SKY130 IHP130 ASAP7 NG45 SKY130 IHP130 ASAP7 NG45 SKY130 IHP130 ASAP7
Total Area(µm²) MAE 1,781.97 18,567.03 48,738.62 225.06 871.07 8,385.61 35,724.45 73.79 571.13 7,505.03 19,487.21 47.23 49.02 854.81 2,339.67 1.98 0.00 0.00 0.00 0.00
MAPE 12.43% 22.51% 20.74% 15.35% 7.07% 11.71% 13.60% 7.50% 4.14% 9.27% 5.56% 3.79% 0.49% 1.22% 0.72% 0.24% 0.00% 0.00% 0.00% 0.00%
R² 0.989 0.957 0.912 0.969 0.997 0.991 0.945 0.997 0.998 0.991 0.979 0.998 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000
Total Power(µW) MAE 11,875.86 46,947.57 17,699.64 6,071.61 5,670.15 19,274.83 16,651.34 2,266.72 5,043.04 19,382.95 15,644.47 2,177.82 280.22 2,270.66 123.65 55.15 0.00 0.00 0.00 0.00
MAPE 27.89% 50.85% 23.71% 33.47% 16.70% 31.36% 18.87% 19.23% 15.37% 30.00% 16.83% 17.57% 0.57% 1.67% 0.24% 0.29% 0.00% 0.00% 0.00% 0.00%
R² 0.948 0.648 0.807 0.823 0.987 0.946 0.781 0.976 0.989 0.944 0.798 0.977 1.000 0.997 1.000 1.000 1.000 1.000 1.000 1.000
Total Wirelength(µm) MAE n/a — cells not yet placed 30,529.92 83,777.43 117,233.52 6,460.04 20,115.77 61,602.30 57,977.64 3,479.88 13,920.52 40,751.29 26,046.32 2,562.35 13,698.67 38,941.02 25,473.38 2,491.87
MAPE 29.21% 34.24% 24.43% 17.17% 19.61% 24.30% 11.49% 7.05% 13.16% 16.18% 5.51% 3.40% 12.53% 14.86% 5.33% 3.28%
R² 0.916 0.902 0.928 0.987 0.959 0.939 0.977 0.995 0.980 0.975 0.996 0.997 0.981 0.977 0.996 0.997
Interconnect length(µm) MAE n/a — cells not yet placed 4.83 12.41 13.19 1.45 4.13 11.8 11.09 1.41 4.19 12.01 11.25 1.44 4.19 11.84 11.17 1.43
MAPE 87.59% 94.04% 72.60% 113.14% 81.33% 86.04% 73.29% 125.55% 78.68% 72.85% 71.34% 123.19% 78.20% 69.82% 70.16% 122.69%
R² 0.735 0.751 0.89 0.886 0.77 0.773 0.916 0.892 0.777 0.791 0.915 0.893 0.779 0.798 0.918 0.895
MAE P95 12.72 38.53 53.88 5.57 10.32 39.23 46.46 5.44 10.82 41.92 46.28 5.85 10.79 41.09 46.08 5.83
MAPE P95 230.82% 293.66% 339.20% 410.10% 186.85% 247.83% 326.04% 403.03% 181.48% 238.43% 291.33% 402.78% 180.77% 234.56% 291.33% 402.78%
MAE TOP5 44.73 116.02 86.57 11.67 46.91 117.87 79.59 11.37 47.4 121.41 80.45 11.65 47.61 121.04 80.05 11.61
MAPE TOP5 24.45% 25.39% 19.20% 18.59% 23.99% 24.99% 18.51% 18.19% 24.18% 25.04% 18.56% 19.03% 24.12% 24.74% 18.49% 18.90%
Worst Arrival Time(ns) MAE 3.10 10.84 8.55 0.09 0.16 0.77 0.41 0.06 0.13 1.21 0.34 0.06 0.01 0.14 0.06 0.01 0.00 0.00 0.00 0.00
MAPE 192.92% 183.71% 331.31% 15.78% 16.19% 21.48% 16.98% 11.17% 13.81% 33.30% 15.82% 10.44% 1.60% 4.69% 2.32% 2.14% 0.00% 0.00% 0.00% 0.00%
Worst Slack(ns) MAE 3.18 11.28 8.83 0.03 0.21 1.15 0.27 0.05 0.15 1.62 0.31 0.05 0.01 0.09 0.04 0.01 0.00 0.00 0.00 0.00
MPE 0.06 0.30 0.30 0.04 0.09 0.27 0.27 0.04 0.04 0.17 0.20 0.03 0.01 0.03 0.04 0.00 no ± error (n_p = n_n = 0)
MNE 3.68 12.15 9.35 0.02 0.24 1.26 0.26 0.05 0.17 1.68 0.36 0.06 0.02 0.12 0.13 0.01
TPR 95.67% 96.32% 94.52% 67.94% 95.67% 96.21% 64.38% 93.08% 95.67% 98.53% 58.90% 99.45% 100.00% 99.47% 96.58% 100.00% 100.00% 100.00% 100.00% 100.00%
TNR 28.70% 15.76% 28.11% 97.70% 57.56% 21.39% 95.54% 63.75% 56.26% 8.39% 91.58% 58.79% 93.24% 60.59% 99.22% 91.53% 100.00% 100.00% 100.00% 100.00%
Total Negative Slack(ns) MAE 1,764.18 17,768.52 3,755.75 1.09 57.74 727.04 0.57 5.65 22.45 959.12 1.05 5.75 2.11 70.22 0.04 1.01 0.00 0.00 0.00 0.00
MPE 1.26 4.74 2.50 3.92 24.60 5.30 1.82 3.76 23.22 2.74 1.88 4.68 4.81 22.51 0.17 1.56 no ± error (n_p = n_n = 0)
MNE 2,296.57 20,176.54 5,201.66 2.10 101.63 849.90 7.15 11.49 37.22 1,031.87 9.00 10.54 6.34 123.39 0.76 3.78
Timing Path Arrival Time(ns) MAE 0.4756 2.9814 1.7195 0.1836 0.2313 0.9552 0.6682 0.1509 0.2398 0.9151 0.6392 0.1462 0.0022 0.0319 0.0041 0.0012 0.0000 0.0000 0.0000 0.0000
MAPE 75.89% 92.31% 95.11% 51.92% 46.25% 39.61% 43.00% 42.55% 45.63% 37.87% 41.34% 41.05% 0.27% 0.80% 0.18% 0.22% 0.00% 0.00% 0.00% 0.00%
MAE P95 1.0541 7.1590 4.6540 0.3296 0.3600 1.5150 0.8949 0.2385 0.3570 1.5320 0.8899 0.2387 0.0107 0.1980 0.0220 0.0036 0.0000 0.0000 0.0000 0.0000
MAPE P95 133.31% 169.45% 241.72% 74.00% 69.54% 64.36% 65.89% 70.09% 69.32% 64.39% 65.77% 70.06% 1.27% 4.81% 0.98% 0.68% 0.00% 0.00% 0.00% 0.00%
MAE TOP5 2.6279 10.1956 1.8427 0.3048 0.2398 0.9467 0.7733 0.1986 0.1971 1.0037 0.7550 0.1975 0.0107 0.1110 0.0246 0.0037 0.0000 0.0000 0.0000 0.0000
MAPE TOP5 208.58% 164.89% 58.23% 36.41% 15.32% 14.73% 24.60% 23.24% 12.57% 15.69% 23.97% 23.01% 0.70% 1.68% 0.73% 0.42% 0.00% 0.00% 0.00% 0.00%
Timing Path Slack(ns) MAE 0.2450 2.6909 1.8879 0.0400 0.0532 0.2179 0.0736 0.0166 0.0280 0.2873 0.0975 0.0203 0.0023 0.0316 0.0040 0.0012 0.0000 0.0000 0.0000 0.0000
MPE 0.0361 1.7111 0.9992 0.0788 0.0282 0.0851 0.0556 0.0150 0.0299 0.1210 0.0741 0.0167 0.0125 0.0351 0.0159 0.0080 no ± error (n_p = n_n = 0)
MNE 0.2749 2.8765 2.8290 0.0222 0.0641 0.4140 0.1082 0.0203 0.0273 0.5783 0.1349 0.0296 0.0217 0.1342 0.0167 0.0149
TPR 98.01% 96.65% 74.89% 70.21% 96.50% 98.01% 74.19% 83.93% 94.90% 97.61% 73.80% 85.13% 93.04% 95.99% 84.56% 95.92% 100.00% 100.00% 100.00% 100.00%
TNR 88.69% 77.61% 93.99% 99.96% 96.00% 90.69% 99.93% 98.69% 97.65% 89.43% 99.92% 98.56% 99.63% 98.34% 99.99% 99.73% 100.00% 100.00% 100.00% 100.00%
Net Arc Delay(ns) MAE 0.1128 0.7713 0.4259 0.0105 0.0200 0.0631 0.0306 0.0066 0.0122 0.0466 0.0165 0.0039 0.0005 0.0046 0.0004 0.0002 0.0000 0.0000 0.0000 0.0000
MAPE >10000% 403.06% 547.23% 39.38% >10000% 28.21% 31.14% 20.69% >10000% 19.99% 8.91% 11.16% >10000% 2.36% 0.32% 0.95% 0.00% 0.00% 0.00% 0.00%
R² <-1 <-1 <-1 <-1 <-1 -0.029 <-1 -0.402 -0.024 0.748 0.876 0.777 0.976 0.981 0.999 0.979 1.000 1.000 1.000 1.000
Cell Arc Delay(ns) MAE 0.0011 0.0031 0.0003 0.0018 0.0008 0.0016 0.0002 0.0003 0.0009 0.0013 0.0001 0.0002 0.0001 0.0003 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000
MAPE >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% >10000% 0.00% 0.00% 0.00% 0.00%
R² -0.308 <-1 <-1 -0.141 0.928 0.873 0.641 0.851 0.875 0.894 0.657 0.925 0.987 0.974 0.975 0.952 1.000 1.000 1.000 1.000
Cell Arc Slew(ns) MAE 0.0761 0.8919 0.4735 0.0152 0.0082 0.0415 0.0059 0.0026 0.0028 0.0392 0.0011 0.0017 0.0003 0.0054 0.0004 0.0003 0.0000 0.0000 0.0000 0.0000
MAPE 183.03% 462.31% 1134.69% 34.33% 27.44% 37.69% 11.05% 7.44% 13.43% 35.60% 2.05% 5.89% 1.27% 4.66% 0.53% 1.01% 0.00% 0.00% 0.00% 0.00%
R² <-1 <-1 <-1 <-1 0.332 0.414 0.965 0.878 0.786 0.427 0.987 0.911 0.973 0.938 0.994 0.964 1.000 1.000 1.000 1.000

Table 8. Averaged baseline prediction error between design stages. Stage labels abbreviate “→ detailed route.” Within each metric, MAE / MAPE are mean absolute / mean absolute percentage error and R² is the coefficient of determination; for timing metrics, MPE / MNE are mean positive / negative error and TPR / TNR are true positive / negative rate. P95 and TOP5 denote the 95th-percentile and worst-5 subsets. n/a — cells not yet placed: wirelength is undefined before placement. no ± error (n_p = n_n = 0): at global route the slack estimate has no over- or under-estimates. >10000% and <-1 are unstable metrics thresholded by the paper, not literal magnitudes.

Cite

If you use these datasets or benchmarks, please cite:

@article{shrestha2026edaschemav2,
  title   = {EDA-Schema-V2: A Multimodal Schema, Open Datasets, and Benchmarks
             for Machine Learning in Digital Physical Design},
  author  = {Shrestha, Pratik and Aversa, Alec and Savidis, Ioannis},
  journal = {arXiv preprint arXiv:2605.06952},
  pages   = {1--39},
  year    = {2026},
  month   = {May}
}