Once again, I have been asked how do we ex-clude x11 lib when compiling software using ports, well, it's easy, just put WITHOUT_X11=yes in place. If you wanna automate the process, excute the following command from your shell.
echo 'WITHOUT_X11=yes' >> /etc/make.conf
That's it.