You can delete a comment after you click Done, but not after you click Save. To delete an unsaved comment, click the X that appears when you hover over the comment field.
Habitat prevents you from deleting saved comments, preserving the commenting history. Set comments to Closed to hide them from view.