I am sure you have heard it before “Facts are stubborn things…”. Their stubbornness lies in proving you wrong if you are.
Going against the grain, being “different” can give you a huge upside, especially if you are participating in a zero sum game, but only if you’re right.
If you are part of a cult and drop everything to be the only few who will be saved, you will not get that benefit if Armageddon doesn’t happen. In the same way, if you decide to short a stock that is rallying, you’ll make a lot more money than those going with the trend, but only if you’re right.
Being a contrarian can give you an edge, but is not enough just to be a contrarian, you also have to be right.