Make sure that clients can't access buffers belonging to other users