Resource consumption analysis for different classifiers (Is there any tool ? )

Question

I'm evaluating different classifiers on a data set. I'll implement the best classifier in terms of accuracy in a smartphone. However, before doing that, I want to compare these classifiers in terms of resource consumption like memory usage, cpu time or battery usage because then I'll be able to compare them in the right sense. The problem is that I'm using WEKA which doesn't have any such resource consumption analysis features. Is there any tool which can give insight into such parameters of performance analysis for different classifiers ? I heard about of RapidMiner but I couldn't find it in their documentation.

regards Zuhaib

Answer 1

I have submitted a similar article with weka about resource consumption. Weka is a normal java tool therefore it does not supply any tool for your purposes but you can use normal Java and operating system tools.

• Memory profiling in java
• Cpu profiling in java

Both of these google searches gives you Visual VM. You can use it to profile your weka program, actually your java code. Also operating system tools gives you another approach like windows performance monitor. Similar tools exists for Smart Phones like , Android profiling, IOS Instruments

Of course also a lot of different commercial tools exists.

At the bottom line, do not expect any tool like weka or Rapid Miner to bring such tools, even if they do, they would be exception and supported features would be less than any generic tool like visual vm.