I'm wondering if it's feasible to use an umbrella in a 21 mph wind.

At 6mph it would be a tussle, but one you might win. In a 21 mph wind you will lose that struggle 99% of the time. Even a poncho is bit of a monster at 21 mph.