Overfit Potential of ANNs and Its Diagnosis

When do neural networks really generalize?