4 Ways to Remove a Paper Label from a Plastic ... - wikiHow Use baking soda and dish soap to dissolve labels that put up a fight. Combine equal parts baking soda and liquid dish soap in a small dish and mix the two ingredients until they form a thick paste. Smear the paste onto the outside of the bottle using a cloth or sponge and let it sit for about 5 minutes before wiping it off.