The only problem is, that fleeting glimpse of the lake is the only time that you see it for the entire journey.
There is never an opportunity to get to the lake shore.
However, a bit of digging around reveals that access to the lake is possible from the Alexandra end, and for those who are willing to endure a bit of physical exercise, there is a chance to explore an old gold-mining settlement located in the lake gorge, at Butchers Point.
If you find yourself at a bit of a loose end these school holidays, this is a trip that you and your family could really enjoy, whether you make it a day trip or combine it with a longer break in the region.
The journey proper begins at the old cemetery at the end of Graveyard Gully Rd, in Alexandra.
You can easily find the road and print yourself a map using Google or Wises maps.
The cemetery is itself worth more than a cursory glance, with the remains of some 30 miners believed to be buried within its neat stone walls.
A central cairn names 16 of those buried there, but the names of the others are not recorded.
Some died in the great flood of 1863 and the big snowstorm on the Old Man Range.
In one corner of the cemetery is an ancient apple tree that still bears fruit, free to those able to climb up to get it.
There is a small car park at the cemetery and the start of the walking track to Lake Roxburgh is clearly marked.
As it happens, there are two interesting sites to visit in the lake gorge.
We chose Butchers Point, taking half a day for the round trip, but a much longer, more demanding walk carries on down the gorge to finish at Doctors Point.
The walking track follows an old sledge track that was used to bring coal into the valley for the many gold dredges that worked the river searching for gold, and is fairly easy going.
The lake itself is more like a river at this end of the journey, and is swift-flowing and deep, but as it makes its way towards the dam at Roxburgh, it slows to become a tranquil lake.
Once you enter the gorge, you cannot help but notice the abundance of thyme.
It grows everywhere, making this a walk through time in more ways than one.
We learnt later, in reading a little more about the history of Central Otago, that the thyme was brought to Otago by the Chinese settlers, and has since spread across the hillsides.
Steep faces to the gorge and huge rocky outcrops are what greet you as you make your way towards Butchers Creek, and in the distance you can see lofty mountains.
Along the bank of the lake are poplars, which during autumn turn gold to give the lake a real Central Otago character.
As you draw near to Butchers Point, you need to keep a sharp lookout for the remains of miners' shelters.
These are not signposted but, if you keep looking at the rocky outcrops on the hill above you, you will spot the carefully crafted buildings set back into natural caves and rocky overhangs.
The old settlement itself is well signposted and the remains of some of the buildings are so well preserved that it is easy to imagine that the miners have only recently left.
Butchers Point is where Colman's Creek flows into the lake, and is where James Coleman (also spelt Colman) discovered gold in 1865 and sparked the gold rush and settlement of the area.
In the gold-mining days, a suspended pipeline crossed the river at this point from Butchers Creek on the opposite bank, to provide a supply of water for mining operations.
Just a short distance on from the township sign is perhaps the best-preserved house on the site, called "Mary Ann's" - the home of a Chinese miner.
The house still has its fireplace intact and must have enjoyed great views out over what would have then been the gorge.
Now of course, with the gorge flooded to become Lake Roxburgh, the house sits near the edge of the lake.
Across from the house, you can see where Butchers Creek flows into Lake Roxburgh. Butchers Creek starts its journey at Butchers dam, which you pass on the way in to Alexandra, so it is interesting to see where the water from the dam flows to.
Spend a bit of time scouting the area and you will quickly find the remains of many more buildings.
Some still have walls, but many are just outlines on the ground.
Every now and again you will come upon another reminder of days gone by with the discovery of rosehip bushes scattered among the ruins.
Butchers Point is a great place to enjoy your lunch before heading back to your vehicle.
One thing to be aware of, though, is that as soon as the sun comes out, the gorge can heat up like an oven, and it is advisable to take plenty of water on your trip.
Across the other side of the lake you can see the dry, barren hills that separate the lake from the highway, and while we were walking the lake shore, occasionally a lone figure would appear on the opposite hilltops, suggesting that exploring that side of the lake might also provide an interesting day trip from Dunedin.