Yes, this, absolutely. While I understand the concept of the "WDW bubble" thing, I don't buy into it. Like you said, we only go to Florida for Disney, so for us the entire central Florida area is our "bubble". It's all vacation, all new and different places from home, just bigger than WDW property alone.
Daytona Beach - we love it. It's only 70 minutes away, you can literally park on the beach and have a great time. At least once each summer trip, we'll drive to Daytona, spend from about 10-3 on the beach, head back to the condo, shower/clean up and then go spend a few hours in a park that evening.
There is a Dunkin Donuts/Baskin Robbins on Rt. 435 (S Apopka Vineland Rd) just outside of Disney Springs. There is also a Bargain World gift shop attached to it. Every single trip, we go there a few times to get ice cream and/or coffee and then the kids love to browse the gift shop for Disney pins.
There's an Ichiban Chinese buffet on Rt. 192, right near Rt. 535. Not fancy at all, but we just have good family fun.
We go to Florida specifically for WDW, but that's one of the things we love most about staying offsite and having our car. We can do so much more than just things on property.