You as an administrator can of course set up that level of detail, but the album owner cannot. So you are right - the only thing the user can do is set the privacy setting.
I will note this as a feature request.
Roger Martin
Creator and Lead Developer of Gallery Server Pro