Exhibit a distribution and a target function that is efficiently learnable by gradient descent on a depth-3 network with polynomially many parameters and samples, and prove that no depth-2 network of polynomial width can learn it efficiently by gradient descent.