You need to override the method getColumnClass() in your table model class (extends from AbstractTableModel).
This method returns Class type for each column, so the TableRowSorter will sort columns...