Do black holes lose their spin over time