Runebot
Computer vision and reinforcement learning agent for Old School RuneScape, paired with a game plugin that reports live game events to ground the agent's decision-making.
Runebot
Runebot is a reinforcement learning agent that plays Old School RuneScape autonomously. Rather than relying purely on screen pixels, the system pairs the agent with a custom RuneLite plugin that streams structured game events — inventory changes, player stats, NPC positions, and more — giving the agent richer environmental context to learn from.
Architecture
Agent — a Python-based RL agent that observes both raw screen frames (via computer vision) and structured state from the plugin. It selects actions by mapping game state to mouse/keyboard inputs.
RuneLite Plugin — a Java plugin running inside the game client that hooks into game events and exposes them over a local socket. This sidesteps the need to infer everything from pixels alone.
Reward Signal — shaped around in-game feedback: XP drops, item gains, HP changes, and task completion events reported by the plugin.