The Caves is a sheltered site immediately west of Crocodile Head on the outer Beecroft Peninsula, and one of the more reliable options on this stretch of coast because it is protected from north-easterly winds – the prevailing summer sea breeze. Depths run from about 12 m to 21 m.

There are two main features. A small cave is typically home to eastern blue devilfish, the brilliant blue-spotted plesiopid that is one of the signature fish of Jervis Bay; they tend to stay in the back of the cave, so approach slowly with a torch. Nearby is a very large cave with overhangs and several swim-throughs, big enough for a group to explore comfortably while staying within the light zone. The surrounding reef is typical outer-peninsula boulder and wall habitat with sponges, sea squirts and gorgonians, bullseyes under the overhangs and wobbegongs resting on ledges.

The moderate depth and the protection from the most common summer wind make The Caves suitable for Open Water divers who are comfortable in overhead environments, and it frequently serves as a second dive after a deeper site such as The Arch or Crocodile Head Gorge. It can also be combined with the neighbouring Crocodile Head arch when seas are flat. As with all the outer Beecroft sites, south-easterly and easterly swell produces surge in the caves, and sea access may be restricted when the Beecroft Weapons Range is in use. Divers should carry a torch to see the colours and the devilfish properly and take care not to stir up the floor.

Charters depart Huskisson (Dive Jervis Bay; boats in Currambene Creek). Private boats launch at Huskisson, Callala Bay or Murrays Beach (Booderee), or at Currarong's ocean ramp. From Huskisson cross the bay to the entrance and turn north around Point Perpendicular onto the outside of the Beecroft Peninsula; The Caves are just west of Crocodile Head on the run between Point Perpendicular and Crocodile Head (about 30 minutes from Huskisson).

Anchor off the cliff on the reef.

The outer Beecroft Peninsula cliffs face east to south-east and take the full force of any south-easterly or easterly swell; the sites are diveable in swell under about 1.5 m and are well sheltered from south-westerly and westerly winds, which make them the go-to sites in winter. North-easterly winds (common on summer afternoons) make the run from Huskisson across the bay entrance rough and cause surge on the northern-facing cliffs. Visibility is commonly 15–25 m and can reach 30 m in winter when clear oceanic water sits against the peninsula.

Currents along the cliffs are usually mild but can run at the bay entrance on a strong tide change. Defence live-firing closures can shut the sea area – check before going. The Caves are protected from north-easterly winds, which makes them a useful choice on summer days when the sea breeze is up.

Visit the small cave first to see the resident eastern blue devilfish, then move to the very large cave and work through its overhangs and swim-throughs with a torch. Finish along the reef outside at 12–15 m before returning to the anchor.

Dive Jervis Bay (Huskisson; boats Avalon and Genesis) runs double boat dives most days, and Deep 6 Diving Jervis Bay / other Huskisson operators also visit; site chosen on the day according to swell and wind.