This article identifies a new upper bound norm for the intervalized interconnection matrices pertaining to delayed dynamical neural networks under the parameter uncertainties. By formulating the appropriate Lyapunov functional and slope-bounded activation functions, the derived new upper bound norms provide new sufficient conditions corresponding to the equilibrium point of the globally asymptotic robust stability with respect to the delayed neural networks. The new upper bound norm also yields the optimized minimum results as compared with some existing methods. Numerical examples are given to demonstrate the effectiveness of the proposed results obtained through the new upper bound norm method.