Country's president has yet to sign ally criminalization bill
Finance Ministry warns country could lose billions in aid
'Limiting the rights of one group in a society undermines the rights of all'
LGBT envoy visited four countries on trip
