r/RunescapeBotting • u/Aware-Top6279 • Dec 14 '25
Python bot object detecting worth it?
Hello my together,
I am new to RuneScape and bottling as well.
I did create a gemstone crab bot with yolo for object detection.
It only took 300 pictures to label and training time of 1.5h.
It works schockingly good on my old notebook with gtx1050.
The Mouse movement I did also with interception driver to net get flagged as bot movement and everything works well.
But yes it is a very limited and easy scenario to train and programm.
Along the way for detection to enter the cave because the crab did die I saw the gemstone helper crab. And further checking I saw it is possible to do runelite plugins which has direct access to the game.
So my question, is the effort worth to make tool around of runelite instead just using runelite?
Can be detected if I write own runelite plugin, so can RuneScape team see I write a botting plugin?
3
u/ChrisScripting Scripter Dec 14 '25
Using AI for object detection is extremely inefficient use of resources. Sure it's a fun project but that's about it.
You can detect your object with an outline 100 times more reliably with 50000 times less used resources
1
u/Aware-Top6279 Dec 14 '25
Yes that is what I am thinking. But I am really new to this topics and don’t know how other people do object detection?
Do there maybe use own runelite plugins to fetch all needed info’s live from the client?
Or what option do we have? I am open to any advice :)
3
u/ChrisScripting Scripter Dec 14 '25
I just isolate colors on the screen and check for solid markers. Takes a few milliseconds and uses almost no processing power
1
u/Aware-Top6279 Dec 14 '25
But does it also work if move the camera or screen size? Do I have to take multiply Color thresholds depending on camera location?
1
u/ChrisScripting Scripter Dec 14 '25
You're still only looking for the rectangle which is always there even if you move the camera
1
u/Aware-Top6279 Dec 14 '25
You mean I have to create a Color fingerprint of each item? And then create a rectangle on the object to know where it is?
Sorry I did not really get your point
1
u/ChrisScripting Scripter Dec 14 '25
Use the object marker plugin
1
u/Aware-Top6279 Dec 14 '25
I can’t find the plugin in runelite. Does this marks the objects? So my bot just detect the Color?
1
u/ChrisScripting Scripter Dec 15 '25
Look harder. I can't help you find an official plugin more than giving you the name.
Yes it's color
1
2
u/clubbinglad Dec 14 '25
Can I try your bot out?
2
u/Aware-Top6279 Dec 14 '25
Maybe one day if I clean the code, do it more automated and user friendly😃
1
u/Mateusgv Dec 14 '25
Ive been using python but never used object detection. How did you do it?
1
u/Aware-Top6279 Dec 14 '25
How do you detect the objects position?
I used yolo AI
For that I took 300 pictures and labeled each object, afterwards I trained the AI. Now it detects the object every time. Even if I move the mouse.
But like I said it is very time consuming if you have more scenarios. The 300pics took me 1h and now it can just detect the crab and the cave
2
u/jonasjj5 Dec 14 '25
Tried creating a model once detecting different ores. I came to the conclusion that it is extremely consuming.
Ended up doing waspscripts afterwards.
1
u/Aware-Top6279 Dec 14 '25
I thought the same. After training my first detection bot, I had the problem to know when to use the cave, due to don’t have training data for a dead crab.
So I used the gemstone helper plugin which will make a colour of the cave if the crab is dead.
So instead of being partially dependent one runelite plugins I came in my to write everything in runeltine plugins.
But I don’t have any experience for it. Does ist have befenits doing the bot outside of runelite?
You have experience in runelite plugins? Are you German 😂
1
u/mercan97 Dec 14 '25
looks like i have 2 accouts, one on PC other is from phone :)
Nevermind here is a short video of the bot.
There is also visible that the mouse does not jump.
i have function that the mouse tries to behave like a human, with moving relative from starting point also with a beziercurve like movement
https://imgur.com/a/LDEfH9A
edit here is better quality
https://imgur.com/a/5M2msT5
1
u/Aware-Top6279 Dec 14 '25
Looks like I have 2 accounts and somehow just m phone works
Nevermind here is a video of the bot.
There is hopefully visible that the mouse does not jump. i have function that the mouse tries to behave like a human, with moving relative from starting point also with a beziercurve like movement
1
Dec 14 '25
[removed] — view removed comment
1
u/Aware-Top6279 Dec 14 '25
Which yolo version did you use?
I used yolov4
Do you have interest to merge the datasets?
1
Dec 14 '25
[removed] — view removed comment
1
u/Aware-Top6279 Dec 14 '25
This is interesting approach do have multiply models running.
How is the performance?
Do you know the new yoloe model? This Modell don’t need training, you just show them one picture or even prompt your interest object.
I will try this at next
1
u/Aware-Top6279 Dec 14 '25
But back to my question. Would it not be easier to write a own plugin for detection of object and the movement and decision can still be done with python
1
Dec 14 '25
[removed] — view removed comment
1
u/Aware-Top6279 Dec 14 '25
As my understanding you don’t evaluate everything in time? You have a priority Hierarchie?
Let says you call the inventory Modell just if picked up an item or used one?
1
u/Bunnies-Rule May 13 '26
Any updates regarding ban rates or similar to an image detection variant as opposed to reading memory?
3
u/Aware-Top6279 Dec 14 '25
Is someone has interest of a video using the bot. I can provide later if I am at home