Senior Sergeant Anthony Bond, of Dunedin, said a 50-year-old man became aggressive with hospital staff in the emergency room about 11.30am.
The man was on the phone with his probation officer and was reportedly "yelling and screaming".
Once police arrived, officers found a 35cm knife in his backpack.
The man was charged with threatening to kill, possession of an offensive weapon and disorderly behaviour.