These two files set "Select Color" for the color picker
wp-includes\js\colorpicker.js
wp-includes\script-loader.php
They are core files and any changes you make will be overwritten by future updates. You should be able to write a filter for the initialization action that adds the meta box