Take a look at the javax.tools package. Be aware that for compilation to succeed, it is required that a JDK be installed. Just a JRE won't do.

Then you'll probably need a custom ClassLoader and...