If there is a way in which someone reliable can look after your children then hajj is wajib and you should do it
However if you don’t have anyone or it causes you unbearable hardship if you go to hajj then you should wait until the opportunity arises to go without this difficulty