Turns out that they were coming back to pick up something they had forgotten! Real important too!!
I launched my boat and saw them about a 1 hour later paddling out to Vargas island.
I guess they got what they were looking for!
I’ve forgotten important things as well!