I know this is late, but...

I think you went a bit overboard.

Start simple to ensure you have the foundation working well.

Server

import java.io.*;
import java.net.*;