I live in a Muslim Bengali community in London and I go to the restaurants within that community. They have the halal labels on their restaurant, but do I have to always ask if they’re Muslim, for it to be permissible to eat their food?

As long as a Muslim tells you it is halal it is sufficient. If they have halal certification that is also sufficient if it gives you certainty. You don’t need to ask.