If accessing two database schemas means just that some of the entities should be in different schema, that can be easily done with Table annotation:
@Entity
@Table(schema="someotherschemathandefault")
public class EntityInOtherSchema {
...
}
If those schemas need different credentials to access (or different datasources to be used), then defining two persistence units is way to go.