This option is only available up to 5 minutes of joining a challenge!
Note: Deleting a photo from your profile does not remove it from the challenge!
In 'My Challenges', tap on an image and the "i" icon at the bottom right corner.
On the next page, in the top right corner, you have the "Trash Can" icon to delete.