The 159-year-old Shand's Emporium building has been closed since the 2010 Canterbury earthquake.
The Heritage New Zealand category one building was moved from its Hereford Street site in 2015 to its new home on Manchester Street in the central city by the Christchurch Heritage Trust.
Mr Gray has teamed up with Cookie Time founder and hemp environmentalist Michael Mayell to open Whakamana.
Mr Gray said the focus of the museum was on education and re-opening Shand's as a boutique cannabis museum was an important step in that plan.
"Being informed and understanding the issues related to cannabis, is absolutely essential to making good decisions.
"Cannabis has been used in some cultures for thousands of years. It used to be the number one industrial crop globally and many don't know that medicinal cannabis was legal in this country less than a hundred years ago," Mr Gray said.
Whakamana will lease Shand's for next five months while they carry out a crowd funding campaign to raise $1 million to transform the adjoining Trinity Church into a permanent space.
Mr Mayell said the ultimate plan was to develop Whakamana to include a hemp food eatery, an alcohol-free nightclub and a cannabis dispensary, should the 2020 referendum on marijuana allow for it.
Mr Mayell said Whakamana would be a community project.
"This New Zealand first will be owned by the public for the public and as interest has already been very high, we are confident that we will reach our goal."
Shand's will open at 11am Wednesday for a gold coin donation, with all proceeds going to the restoration of the Trinity Church.