Hi,
When I've added books to a challenge and then leave the challenge, the book detail page still shows me that I've added it to said challenge.
To remove the book, I have to rejoin the challenge, remove all the books I've added and then leave the challenge again.