But the children at Corstorphine Kindergarten surprised him with a party when he arrived for his weekly visit.
Mr Brown has been visiting the kindergarten every week for the past two years to do small-scale science and construction-based activities.
More than nine years ago, Mr Brown began reading for children at St Kilda Kindergarten but it quickly changed to making things instead.
"I didn’t like [reading] because you couldn’t hold their attention to read a story ... so I somehow got into making things.
"Noisy things in particular they liked."
He remembered the children loved the recorders he made out of PVC for them.
Mr Brown said he had initially organised the visits for a friend grieving the loss of his wife to take his mind off of things.
Mr Brown said his ideas for things to make came from suggestions and a bit of research he did online.
He made things such as birdhouses and gliders for the children.
Corstorphine Kindergarten head teacher Jess Anderson said although Mr Brown thought he did very little it meant a lot to the children.
"A lot of our children, they don’t have grandparents or that great role model, so you’re more than just 15 minutes a week to us," she told him.
He had become known as Grandad Ted to the children and they ran to the entrance to greet him every week when he arrived.
"He truly embodies the essence of community and is creating a lasting impact on the lives of the little ones and everyone fortunate enough to know him.
"The children describe him as amazing, friendly and always smiling."