LDAP is best suited to store data about users - it's a directory. Though it can be used to store pretty much anything, I would certainly not choose LDAP as a data store for a CRM.
Have you looked at http://www.sugarcrm.com/? You can still use your LDAP directory to authenticate users and perform lookups.