Yes, you would expect it to appear in the old generation, but I have seen cases where poorly written code is constantly destroying unused objects but then recreating them from unpurged data elsewhere.
The net result was a lot of stuff in Eden, and very little ever getting beyond tenured memory or more static parts of the memory model. This resulted in a lot of full GCs, but nothing obviously affecting the tenured memory.