Comments on: Get your AOL data on

By: ricky

ricky — Sun, 03 Sep 2006 22:16:36 +0000

what the hell is all this 6 hours about it takes less than a hour

By: Justin

Justin — Tue, 15 Aug 2006 01:52:20 +0000

does anyone want a copy of the mysqldump of the indexed aoldata… full 2gig or whatever file… it would save you 6 hours of indexing… i can zip it if anyone wants a copy

By: max

max — Sun, 13 Aug 2006 20:44:44 +0000

I use postgresql here at http://aol.zanoza.lv. Now building full text index using tsearch2.

By: Justin

Justin — Fri, 11 Aug 2006 04:38:43 +0000

Well i indexed the whole data set today (on all 36m rows) i used CREATE INDEX aolstuff ON aoldata2 (anonid, query); and it took 6 hours and 13 minutes…
machine specs are:

dual p3 750
512 meg Ram
debian linux sarge
mysql 4.1.11 (default debian apt-get package)

if anyone wants to play with the indexed data and doesnt wanna index themself left me know (recklessop@gmail.com or AIM pauljusm

By: Greg Yardley

Greg Yardley — Mon, 07 Aug 2006 21:48:08 +0000

I didn’t bother creating any indexes – when I get a chance to play more with the data I’ll do that and let you know. I need to index at least the AnonID, I’m thinking.

Got to pick up my MacBook from the shop; it’s way faster than this PowerBook G4 and I’ll be playing with both it and this data tonight.

You get a pass on being a pedant as long as you’re a didact.

By: John K

John K — Mon, 07 Aug 2006 20:44:29 +0000

Greg, how long does your mysql box take to add an index to a 36M row table?

Since I like being pedantic and didactic, fyi:
mysql -u root -p none-of-your-business

would start up using a database called none-of-your-business. -p’mypass’ is the way to specify the passwd on the cmd line