Can I delete an offer that has been used in invoices before?

No, editing an offer does not affect existing invoices in any way. Existing invoices are not modified retroactively after an offer is edited. Any changes you make to the offer settings affect only future invoice calculations for invoices issued after saving the changes, while each previous invoice retains the discounts and calculations associated with the offer exactly as they were at the time it was issued.