You can set up filters on the object such that only a person with attribute X value Y can see objects who have a filter value Y. IIRC you do it on the EntryType. You can use wildcards as well to help.
Be aware that this can be a little problematic if you ever want them to see the users at all (they can't).
Peter