I'm lazy, so I'll give you the tutorial quote (http://docs.oracle.com/javase/tutorial/uiswing/components/label.html):


Here is the link to Using HTML in Swing Components.