Intuition and experience. Probably, that's the answer you would get if you happen to ask deep learning engineers how they chose the hyperparameters of a neural network. Depending on their familiarity with the problem, they might have done some good three to five full dataset runs until a satisfactory result …
Volkswagen Group AI Research, in the Munich Data:Lab, focuses on machine learning
and artificial intelligence. Our fundamental research is disseminated through open-access
publications and open-sourced software.