It is not possible to delete an order. For compliance with accounting regulations, you can cancel an order by changing its status to Cancelled.
How to change the status of an order can be found in this article.