Opened 6 years ago

Closed 4 years ago

#1941 closed improve feature (fixed)

Drop google search as it becomes useless and implement a new search

Reported by: shevek Owned by: shevek
Priority: critical Milestone: 2.6
Component: BW Forum Keywords: search
Cc:

Description

The google search engine only sees the posts with world visibility. As these are pretty seldom now we need a new way to find information in the forum.

Change History (23)

comment:1 Changed 6 years ago by pablobd

Now I understand why I couldn't find stuff when I used it, that I knew was in the forum. It's clearly not useful to have this google search, if not for ethical but practical reasons.

comment:2 Changed 6 years ago by beatnickgr

it should be easy to delete the "google search" button, until we make a new search feature... i'm allergic to google...

comment:3 Changed 6 years ago by sitatara

This was also a topic at the unconferece in Brussels: Please implement a proper full-text search for groups and forum threads.

comment:4 Changed 6 years ago by sitatara

  • Summary changed from Drop google search as it becomes useless to Drop google search as it becomes useless and implement a new search

comment:5 Changed 6 years ago by pablobd

I think this needs to be split to two tickets: one for geting rid of the current search, and another to implement a new one

comment:6 Changed 6 years ago by guaka

comment:7 Changed 4 years ago by shevek

  • Milestone changed from unassigned to 2.6
  • Status changed from new to assigned

comment:8 Changed 4 years ago by shevek

  • Owner set to shevek

comment:9 Changed 4 years ago by shevek

  • Status changed from assigned to to_alpha

Use full text search engine sphinx for searching the forums:

https://gitorious.org/bewelcome/rox/commit/93651d14e8503b661cf4bb5beba977521b305163

comment:10 Changed 4 years ago by shevek

  • Status changed from to_alpha to alpha

comment:11 Changed 4 years ago by shevek

  • Status changed from alpha to testing

comment:12 Changed 4 years ago by crumbking

  • Resolution set to fixed
  • Status changed from testing to closed

Teste some stuff and seems to work. Just the translations left

comment:13 Changed 4 years ago by shevek

  • Owner shevek deleted
  • Status changed from closed to reopened

There is a bit more left to this.

  • First a migration with the missing wordcodes.
  • Second a cron job to update the full text index at least once a day
  • Show more than 15 results (that might be pushed to a later milestone though)

comment:14 Changed 4 years ago by Tsjoek

And also:

  • When no results are found all topics are returned instead ("2064 discussions found:")
  • Unexpected behaviour appears when searching for strings containing '<' and/or '/'
  • For search terms that contain several words only the first word is taken into account (not so important)

Great that something is developed in stead of the more or less redundant gse!

comment:15 follow-up: Changed 4 years ago by shevek

  • Status changed from reopened to assigned

Regarding several search terms, I see different results if I search for 'profile' or 'profile visits'. Which keywords did you use?

No idea why it shows 'No permission', when you search for 'a<b'. Maybe we need to add a validation for the keywords, as '/' obviously can't be allowed.

comment:16 Changed 4 years ago by shevek

  • Owner set to shevek

comment:17 Changed 4 years ago by shevek

  • Status changed from assigned to to_beta

Show 'No threads found' when nothing is found instead of all; keep keyword in the searchbox: https://gitorious.org/bewelcome/rox/commit/6123fd807d35fdcd5dcf44620d865352fb61a12c

comment:18 Changed 4 years ago by shevek

  • Status changed from to_beta to testing

comment:19 in reply to: ↑ 15 Changed 4 years ago by Tsjoek

  • Status changed from testing to needs_work

Replying to shevek:

Regarding several search terms, I see different results if I search for 'profile' or 'profile visits'. Which keywords did you use?

I see, pretty sure it was different when I tested it, but don't remember the testcase.

However when testing this, I noticed that I don't really understand why it finds the results that it finds. I will document a bit better this time:

Search: 'Ljubljana' => 3 hits For none of them I can find the word Ljubljana anywhere in the title nor posts.

In the Ljubljana group (I'm not a member) are 2 open threads containing the word Ljubljana but both are not hit. In the brainstorm group (I am a member) I found this thread: http://www.bewelcome.org/groups/267/forum/s9206-Impression_about_BW_and_BV_ containing Ljubljana, but it's not hit.

comment:20 Changed 4 years ago by shevek

Updated the forums index definition. Now two threads are shown, both contain Ljubljana.

The filter currently looks for posts in groups your a member of not for posts that are visible for you. That's probably something we want to improve.

comment:21 Changed 4 years ago by Tsjoek

  • Status changed from needs_work to to_beta

comment:22 Changed 4 years ago by Tsjoek

  • Status changed from to_beta to testing

comment:23 Changed 4 years ago by Tsjoek

  • Status changed from testing to closed

This now works as described. Indeed improvements can still be made, but this is already a giant leap forward, I am now on www actually able to find something interesting in discussions, that wasn't possible before. So closing this one.

Note: See TracTickets for help on using tickets.