Join the best erotica focused adult social network now
Login

Story scores are broken

last reply
37 replies
5.4k views
0 watchers
0 likes
So earlier this morning my poem was at #8 on the all time list thanks to 14 straight 5s.

A few minutes later it was three pages in due to a 3 and a 4. Now this might be just random chance but the statistical likelihood of that pattern is about 0.5%. I think it is rather more likely that someone decided they wanted to push their own work up.

Which got me thinking about how stories should be scored. For example, should a story with 14 '5' scores beat one with 15 '5's and one '4'? How about 50 '5's and one 4?


What I want from a scoring system is to be able to use it to find the type of stories I like. I am not very interested in the relative popularity of the stories. That is possible but very involved to program.


One approach that might help block this type of gaming the system and make it more fair would be to do what they do in the olympics and drop the top x% and bottom x% of the score. If that was the top 10% and bottom 10% I think it would kill this type of abuse.
Quote by ByronLord
So earlier this morning my poem was at #8 on the all time list thanks to 14 straight 5s.

A few minutes later it was three pages in due to a 3 and a 4. Now this might be just random chance but the statistical likelihood of that pattern is about 0.5%. I think it is rather more likely that someone decided they wanted to push their own work up.

Which got me thinking about how stories should be scored. For example, should a story with 14 '5' scores beat one with 15 '5's and one '4'? How about 50 '5's and one 4?


What I want from a scoring system is to be able to use it to find the type of stories I like. I am not very interested in the relative popularity of the stories. That is possible but very involved to program.


One approach that might help block this type of gaming the system and make it more fair would be to do what they do in the olympics and drop the top x% and bottom x% of the score. If that was the top 10% and bottom 10% I think it would kill this type of abuse.


I know I'm not very good at understanding this at the best of times, so I'm sorry.

Are you saying that the stories you like best are the ones rated highly? Or... if it's what I think you're saying, how would the scoring system based on other peoples' likes/dislikes enable you to find the stories you like more?

Is it not more about the category rather than votes? Sorry for not getting it, I am trying to.
Ut incepit fidelis, sic permanet.

***
********************************CLICK THE BANNERS TO BUY THESE WILLY-STIFFENING BOOKS!********************************
Maybe what happened was instead of just your friends viewing your work it was opened out to a bigger field by being on the best of list. People more inclined to give a more honest assessment of your work

I doubt very strongly that everyone on this site having read your poem would have all given you five - it just doesn't happen. Once you get put up as best of the month, editor's pick or similar people will look at your work and assess it themselves and if they don't think it's all that they will mark it down. they won't give a shit about your run of perfect 5s.

We all feel hard done by when we get 3s and 4s - but that's the system. I've no doubt deliberate marking down happens but you also have to open yourself up to the fact that some people just don't like your stuff and live with it.

For the record i didn't read or mark your poem. I've since had a look at it and you'd be lucky to get a 4 from me
Warning: The opinions above are those of an anonymous individual on the internet. They are opinions, unless they're facts. They may be ill-informed, out of touch with reality or just plain stupid. They may contain traces of irony. If reading these opinions causes you to be become outraged or you start displaying the symptoms of outrage, stop reading them immediately. If symptoms persist, consult a psychiatrist.

Why not read some stories instead

NEW! Want a quick read for your coffee break? Why not try this... Flash Erotica: Scrubber
I know it isn't just me who has had a problem with this. It has been an ongoing complaint for ages. And being on the front page means way more views than being on the best of pages.

If you look through the top stories you will find that in almost all the categories what separates the stories at the very top of the list is not how many 5s they get but how many 3s and 4s. And if you look closer you will see that almost all of them have the same pattern. There will be a couple of stories with 20 or so straight 5s and then a bunch with 80 or 90 votes that have been knocked off by a tiny number of low scores.

Dropping the top and bottom scores would make the system a lot fairer as a story with 89 5s and one 4 is no longer going to be ranked behind a story with 14 5s which is just as silly. They do this in olympic competitions to stop the national country judges favoring their own team by giving their competitors low marks and their own high. It works pretty well and is easier to code than trying to track what people prefer.
Quote by ByronLord
I know it isn't just me who has had a problem with this.


I'll give you some 5's if you give my stories some 5's. Deal?

Ooops, I'm sorry... I just remembered. I turned off voting on mine, since I don't like filling out butthurt report forms & forwarding to Nicola.
The same GQP demanding we move on from January 6th, 2021 is still doing audits of the November 3rd, 2020 election.
This isn't the Olympics! Do you seriously think people are voting politically?

I tell you what would be a make a fairer system for any all-time lists on this site: the number of times users have favourited a story. Count up the number of times people have looked at this user's stories and thought "that is so good I'm going to have a link to that on my profile" not just "I'll give it a 5, just like everything else I've scored today"

http://www.lushstories.com/dancing_doll/favourited

Cabo Connection alone has 100 current registered users - that's enough for a Socialite button on its own

Of course, unfortunately, under this system your "poem" would have yet to register a score.
Warning: The opinions above are those of an anonymous individual on the internet. They are opinions, unless they're facts. They may be ill-informed, out of touch with reality or just plain stupid. They may contain traces of irony. If reading these opinions causes you to be become outraged or you start displaying the symptoms of outrage, stop reading them immediately. If symptoms persist, consult a psychiatrist.

Why not read some stories instead

NEW! Want a quick read for your coffee break? Why not try this... Flash Erotica: Scrubber
Quote by overmykneenow
This isn't the Olympics! Do you seriously think people are voting politically?

I tell you what would be a make a fairer system for any all-time lists on this site: the number of times users have favourited a story. Count up the number of times people have looked at this user's stories and thought "that is so good I'm going to have a link to that on my profile" not just "I'll give it a 5, just like everything else I've scored today"

http://www.lushstories.com/dancing_doll/favourited

Cabo Connection alone has 100 current registered users - that's enough for a Socialite button on its own

Of course, unfortunately, under this system your "poem" would have yet to register a score.


I really like the idea of a # times favourited - next to the votes or average score, or somewhere around the story area / in a list.
Quote by nicola


I really like the idea of a # times favourited - next to the votes or average score, or somewhere around the story area / in a list.




Sure, its a good idea, posted in the list or story area. But not instead of the scoring system like it was suggested. Unlike many, I don't just score a five for every friend on my list.
Quote by overmykneenow
This isn't the Olympics! Do you seriously think people are voting politically?

I tell you what would be a make a fairer system for any all-time lists on this site: the number of times users have favourited a story. Count up the number of times people have looked at this user's stories and thought "that is so good I'm going to have a link to that on my profile" not just "I'll give it a 5, just like everything else I've scored today"

[url][/url]

Cabo Connection alone has 100 current registered users - that's enough for a Socialite button on its own

Of course, unfortunately, under this system your "poem" would have yet to register a score.


You are clearly obsessed with the idea that the only reason I would complain is to get my story higher. As a matter of fact the change I propose would mean that the story ranked lower because it would be behind all the other stories that were marked down in the same way. If you look at the all time list, I think you have to agree that flytoomuch's story with 141 votes, almost all 5s should probably rank ahead of a story that has straight 5s but only ten votes.

This is not an easy problem to address. The ranking should probably be done according to the confidence interval on the score. More votes means a tighter confidence interval. Dropping out the top and bottom 10% scores would be a simpler way to make the ranking more realistic.

Yes, I do think people vote politically because this has been raised in other threads and Nicola reported that they had seen evidence of it happening and tried to correct it. The same thing happens on Amazon, it happens on Nielsen too. Fox News ratings crashed when they went from filling in logs to actual measurements. Shows that attract a partisan audience get inflated ratings. Gaming rating systems is a well known effect.

I agree that measuring the number of positives is likely to be better though. I don't think 'average' score is a very useful metric anyway. The low scores are mostly useful to weed out the stories that get lots of them because they are incoherent. It is rather funny to see the scores on the stories, 50 votes for stories that have an average score of 3 and a little Bell curve.

Reporting the number of favorites would be one way to measure positives. But remember that once it is used as a measure, people are going to change the way they use them. But it would also be a good way to start a 'people who liked what you like also liked this' type feature.
On the Cabo connection: adopting my approach of dropping the top and bottom 10% of the scores to calculate the average would mean that its 4.9 average would turn into a 5 with 197 votes and put it at nor near the top of the list on both schemes.

The current scheme results in a disconnect where the ranking of the top placed stories depends almost entirely on the number of not perfect scores which I think is bogus.
Quote by ByronLord
You are clearly obsessed with the idea that the only reason I would complain is to get my story higher.


I'm just going on what said here...

Quote by ByronLord
I think it is rather more likely that someone decided they wanted to push their own work up.


You're accusing two people of voting you down deliberately. This is the conclusion you think "rather more likely" than two people giving your piece a score they felt it genuinely deserved.

Your system disenfranchises people like cocokisses for scoring stories in the way they do. I would suggest that this lower 10% offers you a greater insight as to the true value of your piece.
Warning: The opinions above are those of an anonymous individual on the internet. They are opinions, unless they're facts. They may be ill-informed, out of touch with reality or just plain stupid. They may contain traces of irony. If reading these opinions causes you to be become outraged or you start displaying the symptoms of outrage, stop reading them immediately. If symptoms persist, consult a psychiatrist.

Why not read some stories instead

NEW! Want a quick read for your coffee break? Why not try this... Flash Erotica: Scrubber
Since it's been re-emphasized by admin on more than one occasion that the scoring system is not up for debate, I'll take this back to the original comment/question, which appears to deal not with the scoring per se, but with the method with which stories are ranked. A slight but critical difference.

I agree that people who choose to vote honestly (i.e. not every story gets a 5) shouldn't have their votes invalidated, but that's not really the issue as I see it. I've often wondered the same things that Byron has. Namely, is it a straight average system with which stories are ordered, or is the formula tweaked one way or the other? Is there a minimum number of votes that a story has to get before it's ranked among the other scores in its category, or eligible to put the author in the Top10 on the front page? Why is it that names seem to pop on and off the Top 10 even if the author in question received no votes to cause the change? Is there a delay between the actual votes and their reflection on the category scores and Top 10 list?

I think having this spelled out would answer some general questions. And I believe we can have this discussion without reflexively deriding the OP as a score-whore who's just trying to grease the self-promotion wheels through the scoring system.
The scoring system is what it is. Most of the time I am pretty happy with it. I would much rather have scores than not.
My intent in responding here was not to ridicule or label the OP as a score-whore. My point is simply that to throw out scores, as is suggested, is to devalue a member's opinion. And that would be an unfortunate action. The rating system is what it is and is entirely subjective.

My suggestion is for folks to grow a thicker skin and accept constructive criticism or turn the voting off. Just a thought..
Quote by cocokisses
My intent in responding here was not to ridicule or label the OP as a score-whore. My point is simply that to throw out scores, as is suggested, is to devalue a member's opinion. And that would be an unfortunate action. The rating system is what it is and is entirely subjective.

My suggestion is for folks to grow a thicker skin and accept constructive criticism or turn the voting off. Just a thought..


Coco, posting stories here does quickly thicken our skin,
as does posting non popular opinions on the forum,
but I do find that it is very rare for anyone to offer constructive criticism on the story comments.

More frequently the only comments are with the 5 voters, and I do admit that I refrain from posting any criticism publicly unless the writer specifically request it. Left with the option of sending a private email to the author, it still must be very softly worded...

As someone once said to me, two compliments for each single criticism or your will only be met with a closed ear.


I will admit to once being a score-whore (Gawd, I feel so cheap now)
but now I relish the comments far more.


So all that being said I have now changed my setting to >
A comment must be given when my stories are scored
Quote by FtLMale


Coco, posting stories here does quickly thicken our skin,
as does posting non popular opinions on the forum,
but I do find that it is very rare for anyone to offer constructive criticism on the story comments.

More frequently the only comments are with the 5 voters, and I do admit that I refrain from posting any criticism publicly unless the writer specifically request it. Left with the option of sending a private email to the author, it still must be very softly worded...

As someone once said to me, two compliments for each single criticism or your will only be met with a closed ear.


I will admit to once being a score-whore (Gawd, I feel so cheap now)
but now I relish the comments far more.




FtLMale:

For the most part, I tend to agree with your post. However, the bolded portion... I think not. If most do, then why so many scoring posts and/or PMs to Lush admin?
I just like to see anyone who posts a 3 or lower have to post a comment as to why they are scoring the story that low, rather than be sneaky about it. Have some guts!

I do think there are a very few small minded people who vote extra low scores on some of the best Lush authors' stories out of sheer jealousy.
Quote by MissyLuvsYa
I just like to see anyone who posts a 3 or lower have to post a comment as to why they are scoring the story that low, rather than be sneaky about it. Have some guts!


If I consider a story not worth voting over a 3 for I generally don't view it as worth my time commenting on, just offering the flip side here. ....That said I have, as far as I can remember, always left a comment if I've voted low from the point of view of trying to help the writer to improve their work.
i have a filter on mine that turns all the 1's to 5's. talk to Gav about it!

You can’t truly call yourself peaceful unless you are capable of violence. If you’re not capable of violence, you’re not peaceful. You’re harmless.

Hello lord Byron.

Many others have made good points on here as to the nature of scoring on lush. There is truth to that idea that yes, if usually its just your friends voting then you will have perfect scores. I mean you can look around and notice three paragraph stories that are people's cybersex session put into a half assed structure... Do you think it's a perfect 5? Of course not... But no one besides their friends probably read it.

My stories tend to get get low scores in a timely fashion as well. Like just yesterday I must have pissed someone off cause someone gave my highest scoring story a 2. A story from a series... Maybe they didn't realize it was the second part and they gave it a two? Maybe it was one of the worst stories ever? Maybe I said something they didn't like? Maybe I was above them in the most "popular" section? Maybe they have a crush on someone that gave me attention? Maybe they feel like my story score was too high and wanted to cut me down to size? Maybe they misclicked the two? Maybe my name on the top author list is annoying? And on and on.

So many reasons why someone would want to lower your score LordByron.

There is really nothing you can do about it besides giving all your friends 5s and asking them to give you 5s in return. If you can get 100 perfect 5s going then a two or someone hitting you with a few threes or tons of fours from different devices shouldn't affect you score as much.

You could also turn off voting but what the fuck right?

I think the only way to get authors to stop whining or complaining is this... Might be a bitch to implement but I do think it's the only way to get authors to stop getting bombed or complaining when it happens.. This is my idea.

Similar to the way we can choose our activity feed preferences with the slide bar thingy we could have something for authors to pick their voting preferences.

For example.

Allow guests to vote 1. Yes/no

Allow guests to vote 2. Yes/no

Allow guests to vote 3. Yes/no

Allow guests to vote 4. Yes/no

Allow guests to vote 5. Yes/no

Comment needed for a 1 vote. Yes/no

Comment needed for a 2 vote. Yes/no

Comment needed for a 3 vote. Yes/no

Comment needed for a 4 vote. Yes/no

Comment needed for a 5 vote. Yes/no

Disallow guests votes. Yes/no

If authors had this kind of control then they could shut off guest 4 votes if they are paranoid that as soon as they hit some kind of top or popular list someone sabatages them with a few 4 votes in a matter of seconds.... Or whatever way they feel dicked with they can set their settings to stop it.

This would only work if mandatory low score comments aren't allowed to be deleted after being left effectively nullifying that safe gaurd. I also think its weird to have the option to hide your story votes from your feed. I guess it makes sense if you don't want to be bothered by while reading.. But you can set your boxes to give an automated message or set yourself to invisible or away.

There can be other Yes/No options that I'm sure would be helpful too.. Just haven't thought of them. I do feel that this would put an end to vote tampering and also concerns about sabatage from authors. It may be a bitch to program but in the long run might stop a lot of bullshit.
I am in favour of improving the avarage calculation. Using a truncated mean or similiar, as suggested will mean stories are far less influenced by these rogue 3 scores.

My suggesetion would be the Winsorized mean or as ByronLord suggested the Truncated mean. We couls also consider the Weighted mean.

Who's in?
Quote by gav
I am in favour of improving the avarage calculation. Using a truncated mean or similiar, as suggested will mean stories are far less influenced by these rogue 3 scores.

My suggesetion would be the Winsorized mean or as ByronLord suggested the Truncated mean. We couls also consider the Weighted mean.

Who's in?


Yea Gav! I like anything that's 'mean!' Let's get lean & mean!
Quote by gav
I am in favour of improving the avarage calculation. Using a truncated mean or similiar, as suggested will mean stories are far less influenced by these rogue 3 scores.

My suggesetion would be the Winsorized mean or as ByronLord suggested the Truncated mean. We couls also consider the Weighted mean.

Who's in?


Gav, I will follow you, but can I please have a cool uniform too?


WTF just give me a space suit
Quote by gav
I am in favour of improving the avarage calculation. Using a truncated mean or similiar, as suggested will mean stories are far less influenced by these rogue 3 scores.

My suggesetion would be the Winsorized mean or as ByronLord suggested the Truncated mean. We couls also consider the Weighted mean.

Who's in?



weighted mean; I really do dislike throwing away scores left by readers.
A truncated mean, along with our filters weeding out the votes of jerks, should be the optimal system possible.

I'm really not interested in re-opening discussions about the voting system, for the nth time...
Quote by nicola
A truncated mean, along with our filters weeding out the votes of jerks, should be the optimal system possible.

I'm really not interested in re-opening discussions about the voting system, for the nth time...


Nicola, I think you have an awesome option to end all discussions right there: score stories based on...

Jerk Accomplished



Jerk Half-Finished

Booby Prize (geddit?) for limp ones? That way, people with crappy stories could feel better, and the crap ones would be a bit more interesting.




I think all threads like this should be locked now, personally, cos obviously, this is the answer. You could commission one of the resident artists to do a picture for each selection, and they could change weekly to keep it interesting.

I'd apologise for keeping the discussion going, albeit briefly, but I think you have come up with a stunner of an idea. Well done.
Ut incepit fidelis, sic permanet.

***
********************************CLICK THE BANNERS TO BUY THESE WILLY-STIFFENING BOOKS!********************************
Quote by FtLMale


So all that being said I have now changed my setting to >
A comment must be given when my stories are scored



I didn't even know we had that option...when did that start? I really need to stop by here more often...

I agree that some sort of truncated system would be great, they do it on other sites...but, of course, whatever Nic and Gav decide...and yeah, scoring probably gets discussed way too much...it's probably the hottest topic after pubic hair and cock size around here...just sayin'

You know you want it, you know you need it bad...get it now on Amazon.com...
Lush Erotica, an Anthology of Award Winning Sex Stories
I don't know why there's such an obsession with scores. It's the comments that matter.
Quote by DirtyMartini
I didn't even know we had that option...when did that start? I really need to stop by here more often...


That's what happens when you cheat on us with other sites...you web site harlot you!
I take the point of the original poster and I think there could be a better way of doing things (and a few have been suggested).

What brings me on his side is the fact that one of my stories is ranked as the All-Time Most Popular Oral Sex story with a grand total of... 14 votes. To me, that doesn't indicate that my story actually is the best Oral Sex story on this site (feel free to disagree); not enough people have expressed an opinion on the story to make that kind of claim.

I also rank 13th on that same list with a story which has been rated 27 times - twenty-five 5s and two 4s. Surely this should be considered a better story than the first, no?

Incidentally, this is the first time I realised how popular my Oral Sex stories were.


Edit: I'm just going to slip in a few links to those stories mentioned, in case anyone's interested. (Hey, don't judge me!)
http://www.lushstories.com/stories/oral-sex/the-ethan-blake-story-daves-party.aspx
http://www.lushstories.com/stories/oral-sex/above-and-beyond.aspx