I'd take a look at this:
Wikipedia - Median Filtering

They even have a snippet of pseudo-code, so given your programming background, shouldn't be too difficult to turn into Java.