Don't serialize PeerPtr value in RPC connections