A case for Markovian

[Pavel Kankovsky]

On Thu, 13 May 2004, David Relson wrote:

> Cons:  computing the hash costs time.  Hashes create possibilities of
> collisions.  Collisions can cause incorrect results, for example if both
> "computer" and "refinance" give the same hash code.

It would become next to impossible to search the database for tokens
having certain properties (e.g. all spammy tokens starting with "boo").
And even if the test did not rely on the token itself, you'd still get
a list of hashes rather than intelligible words.

--Pavel Kankovsky aka Peak  [ Boycott Microsoft--http://www.vcnet.com/bms ]
"Resistance is futile. Open your source code and prepare for assimilation."