I have been to both several times. I love both, but so much more to do on HHI.
VB is lovely, but unless you have an oceanfront room or are staying in a cottage you can see ocean due the foliage and landscaping. Not much happening around the resort. It’s actual about 25 minutes north of VB...