Police responded around 10.40am after hearing that a person was seen in the water.
Police and surf lifesavers initially used an IRB in the search, but had to return to shore owing to the conditions.
A helicopter was called in to assist, but the crew failed to sight the swimmer.
In a statement this afternoon police said they had deployed three LandSAR teams who would search the coast for any signs of an exit.
Police would like to hear from anyone who may have seen the person, who is described as of small build and wearing loose black clothing.
Earlier, a policeman said a member of the public noticed someone in the choppy water.
The man looked away for a minute and the person in the water had vanished.
The person was reported to be wearing all black but "definitely not a wetsuit", the policeman said.