Also, each entity has an RSA keypair. Is there any reason I can't just have each application's public key be its unique identifier, instead of the seemingly superfluous UUID?

RSA Security this week announced Key Manager, server-based software for managing encryption keys used in business applications.