I like the baklava at Brioche on Bank street in the Glebe (west side across from the Glebe Meat market). Their strawberry white forest cakes are amazing too and any time I grab one for a party or whatever, everyone loves it.
For pizza, well I like Colonnade but the best is K&S up on Bank street at Albion. Ma and Pa place, 1960's decor..hole in the wall but good pizza!