I've seen people like Connie G Miller wearing pants while showing her dogs and definitely female judges have worn pantsuits. In theory, if the judge is wearing a pantsuit, the handlers should be OK.
Some people aren't very comfortable wearing skirts. It's OK.
Kinda on the same note if you choose to wear a skirt, kinda wear one long enough and "stretchy" enough to bend over in (and skirts are more typically forgiving than dresses for this)... and black skirts go with everything and aren't as distracting.... sometimes have seen interesting clothing choices out there which basically you would think the women would have been better off wearing a nice pair of jeans with a blazer.
One of the last shows I did, there was a woman wearing a peak-a-boo skirt (it was black with eyelet holes) with little tiny biker shorts beneath. More than one judge (in other rings!) were turning around and looking at her running her dog (collie) around!!!
And likewise, there was a handler this past weekend who was wearing a voluminous skirt that unless she was showing a huge dog was bound to distract from her dog! I have no idea what breed she had, but wager it was not big enough for her to be wearing that skirt.
*** FWIW - if we could wear shorts, sandals, and blazer tops - I'd be all over that. There are some business casual shorts that I stare at in certain catalogs...