Ubuntu Servers :: Stopping X From Autostarting?

Ok so I just installed Ubuntu server 9.10. It started out as cmd line only, I ended up installing ubuntu-desktop package from apt ran startx, and from that point on when ever I start the server I get the gui login screen instead of the original cmd line prompt. Now Ive been surfing around the net trying to figure out how to get it back to the original cmd prompt login screen, I really want to use startx when i need a gui.. the main reason I installed this package is really for all the libraries that it contains as i will use a few programs (firestarter, powertweak etc) that use a gui and I figured to make my life simpler i would just install the entire gnome desktop package so i will have everything i need when i try to run these misc programs (most of them will be run thru x11 forwarding as this server will only have internet and power plugged into it) Ive tried disabling gdm startup Ive even removed the /etc/init.d/gdm file all together and it still starts X (i moved it to /usr really but it should(?) work the same as deleting it). there is no other desktop manager to my knowledge (kdm etc).

Ive tried rcconf it says gdm is disabled (i tried disabling it before removing gdm from init.d and nothing), I went thru trying to disable anything that has to do with xserver so far I have only found x11-common I dont think it starts up x but i disabled it anyway. Ive also tried "update-rc.d -f gdm remove" that doesn't do anything either seems no matter what i try i cant stop the gui login screen from popping up.How do i get it to start with the original cmd prompt login?? i am considering reinstalling to get it back but i will lose all my work and that will defeat the purpose