Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
IceKontroI

[SUGGESTION] Script rating feature (pros & cons)

Recommended Posts

This suggestion thread is to entertain the idea of adding a user rating system to associated TRiBot scripts. Here's the implementation of such a system. Once a script is stopped, if it's a public repository script, a dialog box appears asking the user to rate their script experience with either a thumb up or down. Ratings are timestamped and repository search results can now be filtered by average user rating, with an option to only use ratings from the past {day, week, month, year}. Below are any pros and cons worth mentioning that I (or anyone in the comments) can think of. I will also propose solutions to any cons since I know that's what people will tend to focus on.

@TRiLeZ @Todd @Usa

Pros

  • Provides a single unified way to score repository scripts which we currently do not have.
    • Current ways of rating a script are:
      1. Scripter's reputation: not super accurate, only works for popular scripters.
      2. Posts on the script's thread: tedious to read through many recent posts.
      3. User testimonials: anecdotal and typically not representative of the overall experience.
  • It will now be significantly easier for new and experienced users to choose scripts from the Repository.
  • Script writers now have a way to gauge customer satisfaction. This will lead to:
    • More appropriate pricing for scripts.
    • Better script update/patch focus from the scripter.
  • Another reason to choose TRiBot over other clients that do not have a system like this.

Cons

  • Users can repeatedly start then stop the script in order to gain access to another rating.
    • Solved by only allowing a TRiBot user to rate the same script once every 12 hours of real time.
  • Users new to a script that can't figure out how to use it in the first 5 minutes of use will rate it poorly.
    • Solved by preventing users from rating a script until they've run it for at least 6 hours of script runtime (excluding pauses and breaks).
  • User bans will influence user ratings. Keep in mind that bans are a part of the user experience, which is what the rating system aims to measure.
    • High banrate scripts will get lower ratings because of:
      • User error: poor botting practices leads to users blaming the script.
        • This is a universal constant and applies equally to all scripts, so it doesn't affect the comparison process.
      • Overall OSRS botting banrate: another universal constant.
      • Method-specific banrate: some botting methods are more closely monitored than others leading to an unfair rating due to bans.
        • When users compare scripts of the same method, this will be a constant across all those scripts, so it makes no difference.
        • When users compare scripts with diverse methods, the rating they see will not reflect the true rating of the script.
          • This means users will gravitate to lower banrate scripts, which isn't objectively fair, but will improve overall TRiBot user experience.
      • Script-specific banrate: scripts with poor antiban or botlike patterns will be rated worse than others.
        • Good, that's actually the way it should be.
  • Scripters that choose to write scripts for high banrate skills will be seen as worse scripters than they really are. There are two options here:
    1. Simply avoid the methods that are known to have higher banrates.
      • Unfortunately doesn't apply to existing scripts.
    2. Work hard to develop a stringer antiban implementation for the scripts that need it. If you do this properly:
      • Your script will stand out as the only good one in a category of otherwise poorly rated scripts.
      • You will gain nearly all the market share for that category.
      • You can now charge more for the script since the only other options are poorly rated ones.
      • You'll drive innovation in the field of antiban if you are successful here.
  • The implementation of a system like this will take lots of time and resources.
    • It is what it is. A rating system like this will improve TRiBot significantly, but it doesn't come without costs.

Overall, it's not a perfect system, but there are workarounds to many of the issues that do come up. If you can think of any more pros and cons, or better solutions to existing cons, please post them and I'll update the OP. Overall, to me, it seems like the benefits outweigh the disadvantages, most of which are either minimal when you analyze them, or have simple solutions. In the end, the Repository does need some revitalization, and this would significantly improve it and the TRiBot user experience.

Edited by IceKontroI
  • Like 2

Share this post


Link to post
Share on other sites

I used to think a system like this would be great, but bans would play too great a role in rating scripts. The rating should be solely on the script quality. A high quality script can still receive a large amount of bans due to other factors, yet it would still receive a low rating in this system. Unfortunately I don't think there is a way to make a script rating system where bans don't play a part in the rating (implicitly or explicitly).

Share this post


Link to post
Share on other sites
16 minutes ago, HeyImJamie said:

I still vote no to this. I can see it being useful, but other clients have similar and all it's used for is a way for botters to spite the scripter when their account inevitably gets banned.

2 minutes ago, Naton said:

I used to think a system like this would be great, but bans would play too great a role in rating scripts. The rating should be solely on the script quality. A high quality script can still receive a large amount of bans due to other factors, yet it would still receive a low rating in this system. Unfortunately I don't think there is a way to make a script rating system where bans don't play a part in the rating (implicitly or explicitly).

A system like this needs to consider bans in order to objectively capture the user experience sentiment. Is it in the scripter's best interests from a financial gain perspective? Not at all. You two are both premium scripters, so your posts quoted above present a conflict of interest for the new system.

Share this post


Link to post
Share on other sites
27 minutes ago, IceKontroI said:

A system like this needs to consider bans in order to objectively capture the user experience sentiment. Is it in the scripter's best interests from a financial gain perspective? Not at all. You two are both premium scripters, so your posts quoted above present a conflict of interest for the new system.

I don't agree with that view. It could hurt a scripter's income just as much as it could increase it.

Share this post


Link to post
Share on other sites
13 minutes ago, Naton said:

I don't agree with that view. It could hurt a scripter's income just as much as it could increase it.

I agree with you. Overall it will reward scripts that offer a positive user experience, while punishing those that do the opposite.

You said the rating should be solely based on script quality, which would be perfectly fair if scripts all had the same banrate across the board. This isn't the case, and the element of banrate shouldn't be ignored; it's arguably a more important factor to the users than how much GP/EXP the script earns per hour. Rating a script by a combination of its writing quality and banrate encourages not only high quality scripts, but also scripts that use safer methods. That's a good thing for users, which means a bigger user-base, which in turn means more customers for scripters.

Share this post


Link to post
Share on other sites

Throughout the years I've probably gotten 5 times as many users leave feedback about being banned than those who leave positive feedback about their results and I'd like to think that I am one of the better scripters here. So even though my scripts are well respected, I would have an overall negative or low score assuming the verbal feedback I already have gotten were to be translated to a rating system.

Also the fact that you were able to go more in depth about the cons vs the pros just shows this is not a good idea.

Maybe instead of a rating system, just an overall feedback system with predefined responses.

Edited by Encoded

Share this post


Link to post
Share on other sites
7 minutes ago, Encoded said:

Throughout the years I've probably gotten 5 times as many users leave feedback about being banned than those who leave positive feedback about their results.

It's a lot simpler to click a thumbs up/down icon on a dialog box that pops up automatically than it is to open browser -> go to tribot.org/forums -> find the thread -> type and submit a post. This means you need to be motivated to actually go through the current lengthy feedback process, and nothing motivates a tribot botter more than getting banned. Rating systems are shifting towards a simpler format (youtube going from 5 star system to like/distlike system) because simpler formats produce more unbiased feedback.

I'm not saying people will never leave unwarranted bad feedback, but that it's going to be nowhere near as bad as people seem to think it'll be.

Edited by IceKontroI

Share this post


Link to post
Share on other sites

I might implement this into my scripts as a trial run just to see what the results would be.

However my implementation will be different from what you described.
I will only open the dialogue after the user has logged 100 hours (subject to change) with the script and the user will only be able to have 1 rating.

Share this post


Link to post
Share on other sites
2 hours ago, Encoded said:

I might implement this into my scripts as a trial run just to see what the results would be.

However my implementation will be different from what you described.
I will only open the dialogue after the user has logged 100 hours (subject to change) with the script and the user will only be able to have 1 rating.

I would be interested in the results. Please make a thread about it if you do end up going through with that idea.

Share this post


Link to post
Share on other sites
3 hours ago, Encoded said:

I might implement this into my scripts as a trial run just to see what the results would be.

However my implementation will be different from what you described.
I will only open the dialogue after the user has logged 100 hours (subject to change) with the script and the user will only be able to have 1 rating.

100 hours logged weeds out the clueless botters so you don't have to worry about their inability to use/understand the script's setup properly affecting the rating score. This is a pretty smart way to get a more accurate rating. 

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Our picks

    • [READ TO THE END FOR A TEASER]

      I've noticed some new TRiBotters have had some troubles finding out sources of how to do certain things, such as using advanced scripts and often get lost in the forums.

      We are still getting posts asking where to start, what to do, recommended scripts, etc. 

      As many of you know, I am new to the team, and had troubles myself learning how to bot, let alone script. 

      So, what our team decided to do was make it easier to learn how to bot, how to script, and just become an overall better botter and scripter faster. 

      As some of you might have seen, I've posted 3 new blogs, you can check it out by clicking on the following picture or here.


      These first 3 blogs are the first of many blogs that will be TRiBot official. They are encouraged to be challenged, improved upon and act as A Best Practices Guide for Botters.

      What information would you like to see in the blogs?

      👇 [TEASER] 👇

      .

      .

      .

      We are going to be hosting a  CONTEST  this  OCTOBER.

      Its scary to think how soon you'll find out.👻

      Stay tuned.


      - RileyZ
      • 7 replies
    • Today marks a big day for TRiBot! To make it easier for users to use TRiBot, we've created installers available for every platform! These installers are all bundled with the latest version of OpenJDK 1.8 (Java 😎, which is LG compatible.

      Using TRiBot is now easy. Simply download the installer for your platform, install TRiBot, and run it. The TRiBot Loader will correctly identify the bundled JDK so there's no need to change the Java selection.

      Windows

      EXE installer: TRiBot-windows-x64-4.0.3.exe


      MSI installer: TRiBot-windows-x64-4.0.3.msi


      Portable version: TRiBot-windows-x64-4.0.3.zip


      Mac OS

      Installer: TRiBot-macos-4.0.3.dmg


      Portable version: TRiBot-macos-4.0.3.tgz


      Unix/Linux

      Installer: TRiBot-unix-4.0.3.sh


      RPM installer (CentOS/Fedora): TRiBot-linux-4.0.3.rpm


      DEB installer (Debian): TRiBot-linux-4.0.3.deb


      Portable version: TRiBot-unix-4.0.3.tar.gz


      Platform Independent

      JAR file: tribot-loader-4.0.3.jar


      Note that this jar file does not include the bundled JDK.



      Windows and Mac OS users may notice a warning message stating that the installer/application is un-recognized or un-trusted. Please ignore this message and proceed with running the installer/application. We need to acquire a code signing certificate so that we can sign the installers letting the operating system know that these files can be trusted. It will take a week or more to acquire one, so please hold tight.

      Other notable changes to the TRiBot Loader:

      Support getting the version from OpenJDK distributions


      Add check for bundled JDK


      Copy OpenJDK tools.jar to the bundled JDK if not present


      Set the current java as the first available list entry


      Ignore Java versions which are symbolic links


      Make the bundled JDK the preferred Java version


      Update icon images


      Reduce the number of HTTP calls
        • Thanks
        • Like
      • 18 replies
    • TRiBot is looking to improve a lot of its customer relationship management, customer on boarding process, customer experience, design elements, community engagement and pretty much everything else you can imagine when it comes to marketing.

      Our goal: To ensure that the marketing done TRULY reflects the experience and does not shine an inaccurate light on what TRiBot is lacking in.

      So I ask, what do you love about TRiBot and what do you hate about TRiBot? What does O S Bot, Rune M8, PowR Bot and Dre amBot do better? (yes I purposely didn't spell it right 😂).

      Love, 

      RileyZ
        • Like
      • 17 replies
    • Hello TRiBot,

      Today we have a significant release that has been in the works for the last month addressing several key issues, features and bugs in the backlog.

      With these changes, we are also including a new TRiBot Loader which will allow you to select any version that is released. This adds the flexibility of allowing you to revert to a previous version should an issue arise, run development only builds, view an accurate change log between versions etc. we are very proud to offer this feature and think it will add a lot more functionality down the road as we continue to release new versions.

      These changes include 80+ commits by our development team, a list of them is summarized below and also available for your viewing pleasure in the new TRiBot Loader.

      In addition, we have taken additional steps to improve as a development team by adding continuous integration and deployment into our workflow to assist in delivering timely releases such as bug fixes as well as new features on a weekly basis depending on our development cycle.
        • Thanks
        • Like
      • 39 replies
    • Over the last three weeks, I've been working on upgrading our server infrastructure. It's finally ready and is now live!

      Why?

      Increased reliability - less server errors


      Increased availability - less downtime


      Increased security - keeping us and you secure


      Increased capacity - ability to serve you better


      Increased speed - less waiting for things to load


      Faster development - server and service updates will come faster


      What are the changes?

      Move from a single AWS EC2 instance to AWS ECS (Elastic Container Service)


      Distributed computing


      Load balancing


      Git management of server files and filesystem


      Redis caching


      How?

      AWS ECS (with 10 EC2 instances)


      AWS ElastiCache (Redis)


      AWS Load Balancing


      AWS EFS (Elastic file system)


      Please bare with us as I continue to tune the server for maximum performance. Slow loading speeds may occur temporarily. I thank everyone for their patience.

      Please post on this thread if you experience any issues other than slow loading times.
        • Like
      • 51 replies
  • Recently Browsing   0 members

    No registered users viewing this page.

×
×
  • Create New...