Comments on: How does search work? Part II: Making Effective Use of “Stop Words” http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/ Your premium source for custom modification services for phpBB Wed, 11 Jan 2012 20:39:04 -0600 http://wordpress.org/?v=2.8.4 hourly 1 By: Oliver http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-2648 Oliver Tue, 29 Apr 2008 23:31:32 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-2648 great blindness! I just now found your other topic about this with the anwser to my questions :) thanks man... you help me and my users really a lot! great blindness! I just now found your other topic about this with the anwser to my questions :)
thanks man… you help me and my users really a lot!

]]> By: Oliver http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-2647 Oliver Tue, 29 Apr 2008 23:28:33 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-2647 Hi, I can only thank you for all your time and afford you put into all this. This all helps a lot. I ran as well a pretty big forum with seldom less than 1000 guests and around 200 logged in users in the same time. Performance is a big problem for me since the forum grows and grows and it got kind out of hand with the years. I have also a big server with 8GB mem etc. but still the machine suffers a lot. I made so far some changes you sugguest, lets see how this helps. The portal is in portuguese language and it seems my stopwords really suck so I hope this helped me. My wordmatch table droped with the first 30 keywords around 4 million lines down but still has around 21 million and I need to do this more detailed. I never payed attention before in this so i discovered now a lot of 1,2 or 3 letter words in my wordlist table as well as tons of numbers like 1,11,111 etc.... is this normal? thanks again, I am glad out there are people like you.... best regards Oliver Hi,

I can only thank you for all your time and afford you put into all this. This all helps a lot. I ran as well a pretty big forum with seldom less than 1000 guests and around 200 logged in users in the same time. Performance is a big problem for me since the forum grows and grows and it got kind out of hand with the years. I have also a big server with 8GB mem etc. but still the machine suffers a lot. I made so far some changes you sugguest, lets see how this helps. The portal is in portuguese language and it seems my stopwords really suck so I hope this helped me. My wordmatch table droped with the first 30 keywords around 4 million lines down but still has around 21 million and I need to do this more detailed. I never payed attention before in this so i discovered now a lot of 1,2 or 3 letter words in my wordlist table as well as tons of numbers like 1,11,111 etc…. is this normal?

thanks again, I am glad out there are people like you….
best regards
Oliver

]]> By: Boban Alempijevic http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-2340 Boban Alempijevic Tue, 01 May 2007 08:25:41 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-2340 Yess I read all yoru posts and allso about the downside. Out of thoose 45 % (Mathematicly counted) rughly half of it was thanx to something as weird as the custom smilies my Finacee has been putting up on the forum. The names of the smilies are allso stored in same table ofcourse and I noticed that it was not only my imagination that the board was filed with a lott of smilies in most of the posts :) Half of the slimming came thanx to me putting in the names of the arge smilie arsenal into the stopword. I will not go on slimming further, but will instead wait for the mod to get finnished, and I am waiting eagerly for it :) I whish you good luck with writing it mate. Yess I read all yoru posts and allso about the downside. Out of thoose 45 % (Mathematicly counted) rughly half of it was thanx to something as weird as the custom smilies my Finacee has been putting up on the forum. The names of the smilies are allso stored in same table ofcourse and I noticed that it was not only my imagination that the board was filed with a lott of smilies in most of the posts :) Half of the slimming came thanx to me putting in the names of the arge smilie arsenal into the stopword. I will not go on slimming further, but will instead wait for the mod to get finnished, and I am waiting eagerly for it :) I whish you good luck with writing it mate.

]]> By: dave.rathbun http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-2333 dave.rathbun Sun, 29 Apr 2007 16:50:40 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-2333 45% is indeed a nice size reduction. :-) However, adding those extra words to the stopwords file does have a downside in that it will take longer to enter new posts. Have you read the blog post in moving the stopwords into the database, and the time savings it provides? I need to turn that into a formal MOD and have some other folks start testing. In any case, I'm glad you found my post useful, and thank you for your comment. 8) 45% is indeed a nice size reduction. :-) However, adding those extra words to the stopwords file does have a downside in that it will take longer to enter new posts. Have you read the blog post in moving the stopwords into the database, and the time savings it provides? I need to turn that into a formal MOD and have some other folks start testing.

In any case, I’m glad you found my post useful, and thank you for your comment. 8)

]]> By: Boban Alempijevic http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-2332 Boban Alempijevic Sun, 29 Apr 2007 16:18:59 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-2332 My fiancees phpBB2 forum uses a lott of custom smilies. Amazingly enough the wordmatch table went down with 10 MB in size after I ran through al thoose names that was cutommade for thoose weirdo smilies. Theese where words that where no real words so I could safely follow your howto with thoose words. I would guess that some forums having a lot of woman *(such as my fiancees :D ) or a lott of teenagers have allos a huge usage of smilies. worth checking thoose smilies names out with this howto :) might cut down a bit on the table :) Great howto by the way. Slimmed my wordmatch table with allmost 45 % a LOTT of MB :) My fiancees phpBB2 forum uses a lott of custom smilies. Amazingly enough the wordmatch table went down with 10 MB in size after I ran through al thoose names that was cutommade for thoose weirdo smilies. Theese where words that where no real words so I could safely follow your howto with thoose words. I would guess that some forums having a lot of woman *(such as my fiancees :D ) or a lott of teenagers have allos a huge usage of smilies. worth checking thoose smilies names out with this howto :) might cut down a bit on the table :) Great howto by the way. Slimmed my wordmatch table with allmost 45 % a LOTT of MB :)

]]> By: dave.rathbun http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-1458 dave.rathbun Tue, 06 Feb 2007 13:54:51 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-1458 Hi, Xavier, and welcome to my blog. I am glad you found this post useful. There is a Part III already published and Part IV is a draft at this time. Search is such an important part of phpBB for many folks, so any tweaks that can improve how search performs should probably benefit a lot of people. Thanks for your comment. 8) Hi, Xavier, and welcome to my blog. I am glad you found this post useful. There is a Part III already published and Part IV is a draft at this time. Search is such an important part of phpBB for many folks, so any tweaks that can improve how search performs should probably benefit a lot of people.

Thanks for your comment. 8)

]]> By: Xavier http://www.phpbbdoctor.com/blog/2007/01/30/how-does-search-work-part-ii/comment-page-1/#comment-1440 Xavier Tue, 06 Feb 2007 00:46:57 +0000 http://www.phpbbdoctor.com/blog/?p=65#comment-1440 Hi there, This is one of the most interesting posts I ever read regarding this obscure way to handle Search on PHPBB :) I've started to look after my ugly *search_word* tables to find out if they're giving a hard time to the CPU of our webserver :) Well done for your article! Xavier Hi there,

This is one of the most interesting posts I ever read regarding this obscure way to handle Search on PHPBB :)

I’ve started to look after my ugly *search_word* tables to find out if they’re giving a hard time to the CPU of our webserver :)

Well done for your article!
Xavier

]]>