This looks to be what you need to read:
User Permissions and your Plugin
Not sure how you're attaching your plugins setting page at the moment, but when you do it like so:
add_menu_page( $page_title, $menu_title, $capability, $menu_slug, $function, $icon_url, $position );
You get to set the capability the user needs to see it.
Hope that helps!