Research it a little further.

He does not do work for pay, so he is not operating a
business. He works on his own stuff and occasionally
on friends stuff.

The place is neat as a pin, and all work is done inside.

He doesn't work after hours, either. No mention of noises,
music, air guns or smoke.

These busybodies simply don't like the guy.


So, eventually a bunch of holier-than-thou neighbors can
try to force you to stop playing with your HO layout or
watching train videos simply because THEY don't like it.