I was wondering if its backbiting even if we did not intend harm or ridicule of the person.

It is backbiting if you say something derogatory about another person in their absence, irrespective of whether you meant harm or not. The only way it is not is when the person does the bad thing being spoken about openly or you are trying to protect others from their bad actions