Use profiler - The NVIDIA Visual Profiler
is a cross-platform performance profiling tool that delivers developers vital feedback for optimizing CUDA C/C++
applications.
First introduced in 2008, Visual Profiler supports all 350 million+ CUDA capable NVIDIA GPUs shipped since 2006 on Linux, Mac OS X, and Windows.
The NVIDIA Visual Profiler is available as part of the CUDA Toolkit.
See User's Guide Here