We stayed at Port Orleans, Riverside for our 15th wedding anniversary, and loved it. Lush grounds, there is a nice pool, (there were never that many people in it) romantic with the boat taking you to Downtown Disney, and a pool bar, where we exchanged cards. (We gave each other the trip!) We really enjoyed it, and had a king bed. Nice choices on where to eat. The bus service was good. We had breakfast once at the French Quarter, but the giant heads hanging over the dining court were a little creepy for me.
If either of you is a teacher or a nurse, you can get a very good discount at either the Swan or Dolphin. We stayed there our first time at Disney, and it is a short walk over to the Boardwalk (fun at night) and you can easily walk/take a boat to Epcot or Hollywood Studios. There is a nightly resort fee of $10 or so, as well as a fee for parking if you bring a car. They also do not provide Disney's Magical Express from the airport. Those can all add up. Great Pool, however. Romance wise, POR is a little nicer, from our perspective.