How to identify when to move all or part of the data from Sybase ASE to Sybase IQ?

Question

Is there an easy way that any of you guys use to determine this?

Ok, we have more than x gb of data, we should go for IQ! Ok, we have more than x reports going, we should go for IQ! Ok, we have a lot of data archived and need better timings retrieving it, we should go to IQ!

What are the factors that you use to make this decision?

Answer 1

Tough call. Look at it from a transactional RDBMS versus reporting-style OLAP perspective, at a high level. The IQ methodology is column-store, versus a traditional row-store for ASE. Column-stores are very fast when running aggregated queries over them, but that depends on how your reports are run, right?

I think you almost nailed it with this:

Ok, we have a lot of data archived and need better timings retrieving it, we should go to IQ!

So, do your analysis on volume of data you'll be querying all round, that is fairly static or slowly changing. If that's going to be queried a lot, look into IQ.

Don't be scared of a hybrid solution either. I have several SQL Server customers that have massive warehouses running with columnstore indexes, right in the same cabinet as their highly transactional RDBMS.

Answer 2

IQ can be mind boggling fast, but it's a weird creature. It's a mix of the ASA database server (super small and low maintenance, formerly used for embedded applications) and the high-end data warehousing column store db server. Sort of like mixing a tricycle with a Ferrari.

It takes some specialized admin skills (especially if you're using "multiplex" cluster like installations), and the licenses are expensive. If you have tbytes of data, you're doing data mining queries, and your management doesn't flinch at a few hundred thousand for licenses and associated admin personnel cost, go for it (eg, if you're a big bank or something)

Also, keep in mind, that Sybase has been bought by SAP. SAP tends to focus of big huge software packages and they have their own big huge HANA in memory db. I have no idea how well they'll support IQ.