| ioi said: @omgwtfbbq - how do you index nearly 1GB of post content for search? |
hey, I don't want to know how much data google indexes =)
seriously though, it depends on how it's stored. I assume you're using a mysql database, in which case you can create indexes on any column you want:
http://dev.mysql.com/doc/refman/5.0/en/indexes.html
http://dev.mysql.com/doc/refman/5.0/en/create-index.html
then any select statement should return much faster. Although you won't be able to read the database while the index is being built, which could be a problem, as I imagine building an index of 1GB of data could take a while... The other option is to archive a whole lot of that data and only index the last few months worth.
If you're using postgres, I imagine there's a similar option.
As for a flat file database, there are indexing tools available, depending on what operating system it's running on.
Help! I'm stuck in a forum signature!
