Better let the guilty go unpunished than the innocent suffer.

It’s the very cornerstone of justice, a system of law which sacrifices the innocent in its zeal is generally not considered justice, but tyranny. Examples include things like witch trials, or the Khmer Rouge.

Practically speaking: The right time to sentence an accuser for lying is during the trial against the accused, not after.