is it the son’s responsibility (even if he’s not the eldest) to live with his elderly parents? Or can he just help them financially in old age?

The son, whether oldest or youngest doesn’t matter, must fulfill the needs of the parents and be there for them. He does not need to live with them, however he needs to make sure the needs are met.