He does not answer. Rather just looks long and past you. If you press, you get no other information about it, the Gardener simply stares.
When he stares into the distance, does anything change on him physically? Am I able to sense him after asking him that question? My ability to sense him isn't dependent on whether he's good or evil, just corporeal, but I couldn't sense him earlier.