In defense of simple architectures