From the very early days of battling Green slimes with a copper shortsword to finally defeating the Moon Lord and crowning yourself a ruler of Terraria ... it's recommended to fight them.
It boils down to which pillar you'd rather fight more between the Vortex ... most difficult accessories to obtain in Terraria 1.4 because the Moon Lord can only drop it in Expert Mode.