Switches: "Remove from Cart" or "Undo" Functionalities

We ran into a scenario where we used a switch to toggle whether an add-on item would be added to the cart or not -- but what ended up happening was that every time we toggled it, it would add another instance of it to the cart. There was no way to "undo" this properly