vncserver might not be the name of the package, i ran apt-cache:
Code:
# apt-cache search vnc | grep vnc | grep server
libvncserver-dev - API to write one's own vnc server - development files
libvncserver0 - API to write one's own vnc server
libvncserver0-dbg - debugging symbols for libvncserver
gtkvncviewer - Small GTK+ tool to connect to VNC servers
linuxvnc - VNC server to allow remote access to a tty
tightvncserver - virtual network computing server software
vnc4-common - Virtual network computing server software
vnc4server - Virtual network computing server software
vncsnapshot - A utility that takes JPEG snapshots from VNC servers
x11vnc - VNC server to allow remote access to an existing X session
Not knowing what package was installed you want the following command:
apt-get remove linuxvnc tightvncserver vnc4server
That should take care of the removal of vnc server