Chiming in based on your pro/con list, since I also looked at both schools, though I'm not IB.
Yale:
Pros:
+ Proximity to NYC is HUGE, as everyone else has said. The students recruiting for IB haven't just been down to NYC on Fridays (since we don't have classes that day), they also go down if there's a morning or afternoon where we have no class. A lot of people I know were down there Wednesdays, Thursdays, and Fridays in some hectic weeks with multiple coffee chats, informationals, and interviews. All that networking has paid off big time and they're all getting ready for Super Week of interviews in January.
+ Yes, the new building is awesome.
+ Yale brand name is strong as a university. Some will say SOM isn't as strong, but per the first point, all the BBs still come to campus! Recruitment and interviews this fall came from the following (that I remember): GS, MS, JPM, CS, PWP (the one you like!), HL, Wells, Lazard, UBS, Citi... basically everybody. And if they don't recruit directly on-campus, there are surely alums there willing to give you an informational.
Cons:
- Alumni network is weaker in banking (based on linkedin searches) --- I wouldn't read into this at all. It's a smaller alumni network but it's VERY willing to help
- Don't think integrated curriculum is a good fit for someone who wants to specialize in finance. --- see machichi's post above
- BBs like DB and BAML don't recruit on campus. A current student told me that GS didn't hire a single summer associate this past summer. --- Not sure about the GS stat, but there are people with interviews this year so that may change. Also, don't know specifics about DB. I will say from a non-IB perspective on BAML is that a majority of their internships & full-time MBA feeder programs are all based in North Carolina (may convert more Duke MBAs here based on proximity to the school), though they did just post their investment management position so it looks like inroads are being made as the student interest is there.
Some other points you brought up:
+ I am very much into sports and would enjoy the sports culture [at Duke] -- Go Blue Devils! I'm right there with you, actually, but Yale is REALLY into ice hockey so the sports fix is there. It is likely less time intensive than tenting, but if you wanted to tent, I don't think anyone would stop you!
+/- Duke is on the quarter system and an opportunity to load up finance electives during first year. -- Keep in mind here, that Duke has Wednesdays off from class. Not sure how you'll get to and from NYC on a Wednesday since most of the dinners & networking events seem to happen on Thursdays and Fridays from what I've seen, though being further away, expectations of what you have to do to get facetime may be different (someone in finance will be better able to assess this). From a level of course workload though, I'd love to have Wednesdays off to have a break mid-week..ymmv
I'll PM you other specifics on my own decision, but do reach out to the finance clubs to get some perspective there!
_________________