McMenamins / Kennedy School is really cool. It's an old school that's been converted into a hotel. If it's nice out, there's a great restaurant in the courtyard. Otherwise, there are a few different restaurants and bars on the property(the boiler room is the best), they have their own brewery, and there's a movie theatre in the school too. Even if you don't stay there, it's a cool place to go wander around. Surrounding area (Alberta St) is nice too, you might want to look into an Air Bnb house in the area for the family.
http://www.mcmenamins.com/427-kennedy-school-home
Otherwise, I'm usually down there drinking, eating, drinking, partying, drinking and going to concerts with the local "Hipsteresq D-bags" so can't offer much insight on family stuff.