There is a story told that he once vented his frustration, saying "Why can I not find the people to make my ideas work?"
His style was idiosyncratic (like Citroën before Peugeot took over), and he could certainly seem aloof or remote. The correspondence between him and Ricardo Engineering suggests a man who would listen but always go his own way.
I'm not sure that he was as unpopular in Inchicore as some might think - if anything, as a devout Catholic, he had the respect of Inchicore men, if not their loyalty.
In that repressed era, I think those who dealt with Bulleid (or the aftermath of his work) had to be equivocal about their views. Thus you will find material saying that R.A. Riddles on British Railways had quite a bit of respect for Bulleid, and other material that suggests Riddles thought Bulleid to be a charlatan!