Just tried building graphics/ImageMagick-nox11 and noticed it was going to build a slew of X11 components on a server that doesn't want/need/have X11. Noticed that the graphics/ImageMagick Makefile now has
USE_XORG= sm ice x11
without any conditionals around it.
good point, I completely missed the !x11 case.
A commit references this bug:
Date: Wed Aug 10 12:08:06 UTC 2016
New revision: 420009
Don't add X libraries to the nox11 ports 
While here fix USE_GNOME in the SVG case to add to the USE_GNOME macro
and not overwrite it.
PR: 211721 
Reported by: Gary (firstname.lastname@example.org)
Pointy hat to: kwm@
Should be fixed now, thanks for reporting!