Duncan writes request 'raise[s] delicate questions about judicial impartiality'
New judge sought to block Gavin Grimm from boys' room
Duncan, Farr have records against LGBT people, black voters
