Page 167 - 《软件学报》2024年第4期

钱鸿 等: 基于动态批量评估的绿色无梯度优化方法 1745

表 3 对比实验结果表
数据集 算法 全量训练集上的损失 测试集上的准确率 平均评估时间(s)
BOHA 1.2355±0.0013 0.8392±0.0000 10.1394
ASHA 1.2379±0.0024 0.8390±0.0000 8.9035
BatchBO − − −
Fewshot 1.1329±0.0073 0.8544±0.0001 0.1360
SST-2(低维)
Average 1.0809±0.0096 0.8553±0.0002 0.4095
Threshold 1.0748±0.0034 0.8532±0.0002 0.5516
Stochastic 1.0622±0.0034 0.8593±0.0001 0.1403
GRACE (ours) 1.0874±0.0118 0.8622±0.0000 0.3114
BOHA − − −
ASHA − − −
BatchBO − − −
Fewshot 0.9847±0.0163 0.8506±0.0002 0.1472
SST-2(高维)
Average 1.0067±0.0049 0.8565±0.0000 0.4162
Threshold 0.9839±0.0125 0.8630±0.0002 0.6302
Stochastic 0.9541±0.0075 0.8631±0.0001 0.1451
GRACE (ours) 0.9102±0.0351 0.8647±0.0004 0.3016
BOHA 1.7687±0.0161 0.7801±0.0002 16.5034
ASHA 1.7843±0.0134 0.7794±0.0002 14.2637
BatchBO − − −
Fewshot 1.6048±0.0236 0.7960±0.0002 0.6175
AG’s News(低维)
Average 1.5213±0.0135 0.8061±0.0002 1.8549
Threshold 1.5368±0.0239 0.8054±0.0003 1.5093
Stochastic 1.4852±0.0240 0.8066±0.0002 0.6597
GRACE (ours) 1.5132±0.0166 0.8068±0.0002 1.6364
BOHA − − −
ASHA − − −
BatchBO − − −
Fewshot 1.4641±0.0362 0.8098±0.0003 0.4268
AG’s News(高维)
Average 1.5299±0.0148 0.8025±0.0001 1.2690
Threshold 1.4877±0.0242 0.8073±0.0003 1.5411
Stochastic 1.5146±0.0168 0.8033±0.0002 0.4588
GRACE (ours) 1.4478±0.0246 0.8102±0.0002 1.0812
表 3 对比实验结果表(续 1)
2
数据集 算法 验证集上的 R 指标或准确率 平均评估时间(s)
BOHA 0.8347±0.0000 40.9581
ASHA 0.8323±0.0001 77.8718
BatchBO 0.8288±0.0001 16.4311
Fewshot 0.8267±0.0001 1.2787
Housing
Average 0.8317±0.0000 2.7311
Threshold 0.8354±0.0001 0.9612
Stochastic 0.8314±0.0000 0.8966
GRACE (ours) 0.8446±0.0001 3.6170
BOHA 0.8690±0.0001 64.6879
ASHA 0.8478±0.0019 73.1404
BatchBO 0.8472±0.0007 43.9048
Fewshot 0.8247±0.0010 0.3832
CovType
Average 0.8475±0.0011 19.5978
Threshold 0.8170±0.0006 6.2001
Stochastic 0.8714±0.0011 1.5143
GRACE (ours) 0.8910±0.0006 8.2153
BOHA 0.9658±0.0000 12.3648
ASHA 0.9667±0.0000 13.3524
BatchBO 0.9533±0.0001 6.9905
Fewshot 0.9717±0.0001 0.4019
Digits(批量大小=50)
Average 0.9683±0.0001 1.0083
Threshold 0.9706±0.0000 0.8316
Stochastic 0.9700±0.0001 0.3711
GRACE (ours) 0.9725±0.0000 1.0268