What can I do to get removed from an ex's loan?

If he's been paying on time, it means his credit is just as important to him. It would be foolish to take him to court and get him upset. Perhaps if you offered him money to refi it that might do the trick. Just make sure you see the satisfied papers before you pay him.