The Credit Note can be deleted by:

Clicking to delete the Credit Note you will then be prompted to confirm your actions:

NOTE: A Credit Note cannot be deleted once it has been sent to the buying organisation