Tuesday 6 February 2007

Rhizomes - Efficiency of Comparisons

Rhizomes - Efficiency of Comparisons

Using symbols, rather than storing values, leads to savings in processing when a query has conditions. (Especially complex conditions.)

For example:

If a column has 10^9 records with 10^6 distinct values, then performing complex comparisons on 10^6 values is 10^3 times faster than doing likewise on 10^9 values.

Complex comparisons can include regular expression, or multi-column, comparisons.


Also, values can be grouped and ordered in arbitrary fashions. We could sort a 10^7 record subset (with 10^4 distinct values) of 10^9 records in any way much more quickly than sorting a traditional table.

No comments: