Of course, there would be a higher chance of vulnerabilities. But you’re not required to use the panel. It’s an extension of the software, not a key component.
Indeed it’s one reason why there is no GUI right now - but always good to see what creative things folks can do to extend Centmin Mod 