DBN Size |
num epochs |
batch size |
momentum |
alpha |
learning rate |
num epochs |
batch size |
error |
Remarks |
|
|
|
|
|
|
|
|
|
|
EPOCH No. Variation |
|
|
|
|
|
|
|
|
|
100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
8.91 |
|
100x100 |
2 |
100 |
0 |
1 |
1 |
2 |
100 |
7.31 |
|
100x100 |
5 |
100 |
0 |
1 |
1 |
5 |
100 |
5.66 |
|
100x100 |
10 |
100 |
0 |
1 |
1 |
10 |
100 |
4.51 |
|
100x100 |
20 |
100 |
0 |
1 |
1 |
20 |
100 |
3.46 |
|
100x100 |
50 |
100 |
0 |
1 |
1 |
50 |
100 |
2.64 |
|
|
|
|
|
|
|
|
|
|
|
DBN Size Variation |
|
|
|
|
|
|
|
|
|
100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
8.91 |
|
100x100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
10.16 |
|
100x100x100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
10.74 |
|
100x100x100x100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
13.94 |
Too big error |
|
|
|
|
|
|
|
|
|
|
Learning Rate variation |
|
|
|
|
|
|
|
|
|
100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
8.91 |
|
100x100 |
1 |
100 |
0 |
1 |
2 |
1 |
100 |
7.56 |
|
100x100 |
1 |
100 |
0 |
1 |
5 |
1 |
100 |
6.13 |
|
100x100 |
1 |
100 |
0 |
1 |
10 |
1 |
100 |
41.64 |
Too big error |
|
|
|
|
|
|
|
|
|
|
Batch Size variation |
|
|
|
|
|
|
|
|
|
200x200 |
1 |
20 |
0 |
1 |
1 |
1 |
100 |
7.97 |
|
200x200 |
1 |
50 |
0 |
1 |
1 |
1 |
100 |
7.75 |
|
200x200 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
8.01 |
|
200x200 |
1 |
200 |
0 |
1 |
1 |
1 |
100 |
10.32 |
|
|
|
|
|
|
|
|
|
|
|
Alpha variation |
|
|
|
|
|
|
|
|
|
100x100 |
1 |
100 |
0 |
0.1 |
1 |
1 |
100 |
81.97 |
Too big error |
100x100 |
1 |
100 |
0 |
0.5 |
1 |
1 |
100 |
23.07 |
Too big error |
100x100 |
1 |
100 |
0 |
1 |
1 |
1 |
100 |
8.91 |
|
100x100 |
1 |
100 |
0 |
2 |
1 |
1 |
100 |
7.67 |
|
100x100 |
1 |
100 |
0 |
3 |
1 |
1 |
100 |
45.04 |
Too big error |
100x100 |
1 |
100 |
0 |
5 |
1 |
1 |
100 |
37.24 |
Too big error |
|
|
|
|
|
|
|
|
|
|
General Tries |
|
|
|
|
|
|
|
|
|
100x50x25 |
1 |
100 |
0 |
1 |
2 |
1 |
100 |
9.34 |
|
500x500 |
10 |
50 |
0 |
1 |
5 |
10 |
50 |
2.05 |
Best so far |