Why does this method not work in SUN and aPY dataset？

[kyz20]

I have tried RN in SUN and aPY， but it did not work, so why?
Why does RN can get good performance in AWA and CUB but not SUN and aPY?

[harpavatkeerti]

Same doubt, also why is the hidden layer size different for each dataset, and how is it chosen?