Skull Island is a popular spot but you need to be very careful especially at low tide... Lots of old submerged pilings and rock 20 or so feet off the insland towards land which I found first hand
Make sure you have a good chart plotter and you can follow the unmarked channel that starts in the Highlands and runs to the Island like you see below.
Good luck, go slow and be safe.
