I think the high rise is too insane any time of the year for a yak.
The dangers, not necessarily in order:
1. The tides within 1000 yards of fisherman's island are just TOO BRUTAL. either outgoing or incoming, the volume of water coming around fisherman's island is about ten times the normal amount. All you have to do is look at a map of the bay and see how the water coming out, or going into the bay creates a huge rip zone with the volume of everything north being bottlenecked. That water does not take a smooth, long turn after heading down past the third island. It races out the quickest, way as it gets sucked out or pushed in around that point. Even the best touring yakkers would never be able to hold a position. Dead tide, or even slow tide does not exhist there.
An exellent, fit, touring class sea kayaker could safely navigate through there going with the tide, but never against (as long as he planned on ending up a long way away)
2. It is very long paddle out there from the closest put-in with the tides.
3. The waves created from the rips around the point are 2 feet higher than everywhere else in the bay.
the rips and currents on the northeast and north side of fisherman's island are pretty manageable, as long as you don't get close to the southern edge.
The small boat channel (north) and flats (6-12ft. deep) north of the island are an easy paddle, and should get you a chance at most things you would find at the high rise. big stripers, cobia, drum, Etc.