Ball joint rivet removal tool