He does not allow on the basis that he thinks that it is forbidden for a women to go alone. If there's any reference which allows a women to go alone.

It is allowed as long as the husband doesn’t forbid her from going.