Creating custom waypoint icons

How do I create custom Waypoint icons to replace the blue dots under "Custom" in the drop down window?