Yes it is wajib
Kindly talk with them and explain them importance of khums In’Sha’Allah they will pay their khums and your too
If not then you have to pay your khums it is wajib but try to resolve this issue in respectful manner and get their blessings and support in following the command of Allah which is wajib on you and them also