To clean glass straws, first rinse them with warm water. Then, give the glass a good scrub with a bristle brush, hot water, and dish soap. Doing so should eliminate any residue and leftover particles trapped inside the straw. Because glass can get foggy or cloudy from repeated use, try soaking the straws in a solution of vinegar and bicarbonate of soda to help restore its shine. Best Straw Cleaning Brushes Just as there are a ton of plastic straw alternatives out there, there are similarly a bunch of straw cleaning brushes, which can make it difficult to decide which option to choose. A good cleaning brush for your metal, silicone, or glass straw does not have to be expensive or fancy. Here are some reliable, great straw cleaning brushes you can get right now.