Date   

moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Duane
 

On Sat, Nov 21, 2020 at 04:24 PM, Glenn Glazer wrote:
I'm simply pointing out that the relationship between the search results order and the actual search term are not necessarily due to Elasticsearch, as you asserted.
True, it's totally dependent on what order the database is saved.  Elasticsearch will list them in the order they're retrieved from the search, since all results will have a score of 1, unless some processing is done.

Duane


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Glenn Glazer
 

On Sat, 11/21 14:18, Duane wrote:
On Sat, Nov 21, 2020 at 03:52 PM, Glenn Glazer wrote:
But that order is effectively random.
Not completely.  It has to be searching the (listed) group-name/description database which is apparently stored in ASCII order.  Since the results page shows By Name, then it's doing a bottom up search.  Anyone with a bit of computer programming experience knows that in ASCII all of the upper case characters come before all of the lower case characters which is the reverse of the order the results are listed - bottom up.

Duane

If the search is specified without a sort order, then elasticsearch does not promise an ordering to the result set as that SO link pointed out. As J_Catlady pointed out, the code could very easily be doing post-processing on the result set. What we see are the final results, none of us have the ability to determine which part of the code is doing what.

I'm not arguing that the end effect is desirable. I definitely agree there is room for improvement. I'm simply pointing out that the relationship between the search results order and the actual search term are not necessarily due to Elasticsearch, as you asserted.

Best,

Glenn

--
PG&E Delenda Est


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Duane
 

On Sat, Nov 21, 2020 at 03:52 PM, Glenn Glazer wrote:
But that order is effectively random.
Not completely.  It has to be searching the (listed) group-name/description database which is apparently stored in ASCII order.  Since the results page shows By Name, then it's doing a bottom up search.  Anyone with a bit of computer programming experience knows that in ASCII all of the upper case characters come before all of the lower case characters which is the reverse of the order the results are listed - bottom up.

Duane


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Glenn Glazer
 

On Sat, 11/21 14:02, J_Catlady wrote:
On Sat, Nov 21, 2020 at 01:52 PM, Glenn Glazer wrote:

But that order is effectively random.
If so, then groups.io apparently does a bit of post-processing to put the results in reverse alpha order with lowercase names first. Either way, the display order totally unrelated to the search term. An extremely simple fix would be simply to prioritize the groups with the search term IN the name (especailly since groups.io itself calls the search "By Name"). If groups.io is already post-processing the results of elastisearch, it may as well do it in a way that makes a nonzero amount of sense.

I've never seen the code, I can't speak to what it does or doesn't do.

Best,

Glenn

--
PG&E Delenda Est


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 01:52 PM, Glenn Glazer wrote:

But that order is effectively random.
If so, then groups.io apparently does a bit of post-processing to put the results in reverse alpha order with lowercase names first. Either way, the display order totally unrelated to the search term. An extremely simple fix would be simply to prioritize the groups with the search term IN the name (especailly since groups.io itself calls the search "By Name"). If groups.io is already post-processing the results of elastisearch, it may as well do it in a way that makes a nonzero amount of sense.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 01:58 PM, J_Catlady wrote:
The display does not
Should read "the display order does not"
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 01:43 PM, Duane wrote:
I believe there is.  It's the order that Elasticsearch found them
Which, as you yourself have said repeatedly, is nothing more than reverse alpha with lowercase names first. This has zero relationship to the search term. The set of results is related to the search term. The display does not.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Glenn Glazer
 

On Sat, 11/21 13:43, Duane wrote:
On Sat, Nov 21, 2020 at 02:41 PM, J_Catlady wrote:
There is currently NO relationship between the search results order and the actual search term.
I believe there is.  It's the order that Elasticsearch found them in the (listed) group-name/description database.

Duane

But that order is effectively random.

https://stackoverflow.com/questions/23919296/how-is-elastic-search-sorting-when-no-sort-option-specified-and-no-search-query

Best,

Glenn

--
PG&E Delenda Est


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Duane
 

On Sat, Nov 21, 2020 at 02:41 PM, J_Catlady wrote:
There is currently NO relationship between the search results order and the actual search term.
I believe there is.  It's the order that Elasticsearch found them in the (listed) group-name/description database.

Duane


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

The bad examples are more frequent than the good ones. In a search on "IBD," three groups that just mention the term tangentially in their descriptions display first. (One of them uses the term simply to say that the group does NOT deal with IBD.) The only group that is *specifically* about IBD (and has "IBD" in its title) comes up last. In this case, there are only four groups total. But in other cases there can be a page or more before the actual relevant group even shows up.
https://groups.io/search?q=ibd

--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 12:26 PM, Donald Hellen wrote:
Yahoo Groups seemed to
have a more relevant search results order
Would be hard not to. There is currently NO relationship between the search results order and the actual search term.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Donald Hellen
 

Yes, to me this is important and it doesn't work intuitively like
that.

Donald



On Sat, 21 Nov 2020 06:50:13 -0800, "J_Catlady"
<j.olivia.catlady@gmail.com> wrote:

That's well and good. However, group owners with the search term in their group's name would expect the reverse: namely, not to be displayed pages below a group that only mentions the term in their description, in some cases only tangentially.

----------------------------------------------------
Some ham radio groups you may be interested in:
https://groups.io/g/ICOM https://groups.io/g/Ham-Antennas
https://groups.io/g/HamRadioHelp https://groups.io/g/Baofeng
https://groups.io/g/CHIRP https://rf-amplifiers.groups.io/g/main


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Donald Hellen
 

The list is indeed too large and it doesn't sort on relevant terms in
the groupname. If I wanted to look through hundreds of groups that
have the words in their description and not the groupname, I would
expect those to show up further down the list. Yahoo Groups seemed to
have a more relevant search results order if I remember correctly.

Donald

On Fri, 20 Nov 2020 19:41:54 -0800, "J_Catlady"
<j.olivia.catlady@gmail.com> wrote:

Is that because the list of groups returned is too large and hard to sort through because it is displayed in a non-helpful way (I would agree there), or because many of the groups returned are irrelevant because of the lack of any sort order other than alphabetical (I would agree there also), or because the list of groups returned simply doesn't contain groups you're looking for (which we've seen can happen by Duane's example)? Or a combination of all three? Would adding the ability to sort by Most Popular, Most Recent, or Most Active help?

----------------------------------------------------
Some ham radio groups you may be interested in:
https://groups.io/g/ICOM https://groups.io/g/Ham-Antennas
https://groups.io/g/HamRadioHelp https://groups.io/g/Baofeng
https://groups.io/g/CHIRP https://rf-amplifiers.groups.io/g/main


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 10:04 AM, Curt Gowan wrote:
from "Group not listed in directory, private messages"
to      "Group listed in directory, private messages"
Of course, because if your group was not listed in the directory, it is not findable and would not display to the public. Now it's subject to whatever search/display criteria are being used, with all the attendant problems being mentioned here.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

FWIW, words or phrases in the description of our parent group started coming up in searches immediately after I changed 
Settings > Privacy > Visibility 
from "Group not listed in directory, private messages"
to      "Group listed in directory, private messages"

Words or phrases in the description of a subgroup are not findable, which is makes sense.
To work around that, I added one line about each subgroup to the description of the parent group. Now findable.

--cg


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

Still doesn't solve these issues.
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 08:53 AM, Chris Jones wrote:
the search results are based on what a group owner puts in the description,
Thanks, I intentionally inserted "feline lymphoma" into the description somewhere right after seeing Duane's results.
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Chris Jones
 

On Fri, Nov 20, 2020 at 08:59 PM, J_Catlady wrote:
How can I change the name of my group to have it display in a "feline lymphoma" search?
Actually it is quite easy, without changing the group name. Starting with the fact that the search results are based on what a group owner puts in the description, then simply ensure that "feline lymphona" is in the description. I suspect that your immediate response might be that that could leave the description looking messy, but in fact the words don't need to be visible, simply present.

Eh? Sadly I cannot demonstrate this in beta because the tool bar above the composition window does not let me change font colour, but that for a Group Description does. Somewhere at the bottom of the description on your Home Page add a few additional search terms (e.g. "feline lymphoma") and the change the font colour to white. It can also be useful to set the font size to be (very) small so that numerous helpful words can be accommodated without taking up too much space; that space will simply appear as white (empty) space to anyone looking at your description.

Although the words are invisible to the human viewer they are not invisible to the search engine, so anyone using any of your "hidden words" will find your group quite easily, or at least they should do.

If you want a demonstration of this please let me know and I'll post a couple of search terms for the group I co - own so that you can search for it, find it in one go and then "find the search terms" in the description!

Chris


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

 

On Sat, Nov 21, 2020 at 07:03 AM, Duane wrote:
FWIW, there has to be some default results order,
Of course! We get that. But this needs a change at some point. At the very minimum, if there is no time to fix the display order, stop calling the search "By Name." That would be a five-second fix. "By Name" leads people to believe they are actually searching on the group name. No one would guess that the name is really treated equally with the description and that the rsults will simply be displayed by name (and in an unintuitive order, at that).
 
--
J

Messages are the sole opinion of the author, especially the fishy ones.
My humanity is bound up in yours, for we can only be human together. - Desmond Tutu


moderated Re: What is the algorithm for the display order of groups after entering a keyword search? #misc

Duane
 

FWIW, there has to be some default results order, so the existing is as good as any.  If Mark decides to include any of the suggestions in this topic, such as an "advanced" search page/box, there will still need to be some default.  Other than boosting Premium groups to the top of the list, I don't think I'd make any other changes for that.  No default behavior will ever meet everyone's expectations though.

Duane

2721 - 2740 of 29410