The idea of pleasing Ahlulbait is not necessary based on meeting them nor the idea of not meeting them necessary translates into them not being pleased with us. We must simply strive to follow their teaching and remain steadfast on their path. Working on the assumption that I will do everything I can only so I can meet the imam is not a healthy phenomenon because of the very fact that it may lead you to doubt and speculation just like what happened in your case. Rather you must adhere to their teaching and that in itself is what pleases Ahlulbait