DOH!!
I guess that's what happens when you wake up and do math first thing in the morning!
You're right, it is at least, and there are two ways to do it. It's actually not that complicated to do it your way, since there's a bunch of cancellation anyway. So you'd get the 60 from 2 members, and 40 from 3 members, and 5 from 4 members, and add them to get 105.
Alternatively (and I don't think I'd do it this way, but it is possible), because it's "at least" that means that you could take away anything that DOESN'T fit the scenario. So that means you wouldn't want possibilities with no union members, or with just one union member. In that case, you could figure out how many total committees there are all together ([9x8x7x6]/4! = 126) and then subtract out the number of committees with only non union members (1) and the number with only one union member (20) and you'd get 105, also.
But considering the fact that if you're getting this stuff, the first way takes about 45 seconds all together, I think it's an appropriate approach to a GMAT problem.