Unfortunately you will need to do some scrolling. To jump to a certain color, do command + F and type in the color name.
