The legal duty to keep VAT records, generally for six years.
For self-billing this includes the agreements, a list of suppliers with their VAT numbers, and copies of every self-billed invoice.
General information, not tax advice — confirm your own position with your accountant or HMRC.