It turns out that a hot solution of alum (ammonium aluminum sulfate), which is available in the spice rack of your local supermarket, will dissolve the steel drill bit without reacting with the brass.
Carefully dab the Q-tip onto the paint, allowing the acetone to dissolve it, and then wipe away with a clean cloth and soapy water. One of the pros and cons of installing aluminum window frames is ...