Recently, I found an arabic anthology Poetry by Imam Ali ibn Abi Thalib (as) called Diwan Imam Ali ibn Abi Talib (as) is it authentic according to shia?

It is similar to books of narrations. Some of it is but we cannot claim that all of it is.