Intuition and experience. Probably, that's the answer you would get if you happen to ask deep learning engineers how they chose the hyperparameters of a neural network. Depending on their familiarity with the problem, they might have done some good three to five full dataset runs until a satisfactory result …
Machine-learning algorithms thrive in environments where data is abundant. In the land of scarce data, blessed are those who have simulators. The recent successes in Go or Atari games would be much harder to achieve without the ability to parallelise millions of perfect game simulations.
Established in 2016, Volkswagen Group AI Research, located in the Data:Lab, was set up as a fundamental research lab on topics close to what we think artificial intelligence is about: machine learning and probabilistic inference, efficient exploration, optimal control, and quantum computing.
Volkswagen Group AI Research, in the Munich Data:Lab, focuses on machine learning
and artificial intelligence. Our fundamental research is disseminated through open-access
publications and open-sourced software.