EyeAuras  is an automation tool that allows you to model desired behaviour via system of Triggers and Actions. Color search, image search, OCR (text recognition),  global and conditional hotkeys in conjunction with a wide variety of ways to emulate user input bring up an extremely powerful tool to your toolset. And, as a cherry on top, you can always fallback to C# for triggers and actions.

Getting Started

Main concept

  • Aura - combination of Triggers, Actions, Overlays and Enabling conditions. This is what you'll share with others, and this does the actual work.
  • Enabling conditions
  • Triggers - any kind of state which could be described in Active/NotActive terms. This could be Hotkey (pressed/unpressed or toggle),  foreground Window check (active/not active), Image/Text/Color search result(matched/not matched).  Aura Active/NotActive state is a combination of states of her child Triggers. Trigger has three states:
    • Active - this means that condition is met, e.g. for WindowIsActive trigger this means that Window with matching title is Active
    • Not Active - this means that conditions is not met
    • Unknown - this means that for some reason it is not possible to calculate trigger state. For example, if Window specified in ImageSearch is not found that means that corresponding Trigger will have Unknown state as it is not possible to do comparison without any actual image.
  • Actions - showing notifications, key/mouse presses, sending Telegram messages  or e-mails - these all is considered an Action and could be used inside Aura. Actions could be assigned to one of 3 groups:
    • On Enter -  these are executed when Aura becomes Active
    • While Active - these will be executed repeatedly while Auras is Active
    • On Exit - these are executed when Aura becomes Not Active
  • Overlays - always-on-top overlays which could show text, image, custom UI or anything else. Overlays are a part of Aura and are shown only while Aura is Active

Triggers

  • Fixed Value - the most primitive trigger, you can control it's state by selecting it either manually or by using C# scripts
  • Color Search - active when Average color of a selected region matches with Target color. Similarity threshold could be specified.
  • Image Search - active when some Image is found with a specified similarity
  • AI/ML Search - machine-learning powered object detection/segmentation or classification, currently supports only Yolo8 in ONNX format, may be extended later
  • Text Search - active when recognized text matches with specified expression. It could be comparison by Contains, regexp or C# Lambda
  • Aura Is Active - active when linked Auras have specified state (Active/NotActive)
  • Hotkey Is Active - active when specified combination of keys is either held down or toggled
  • Window Is Active - active when window matching specified expression is active (in foreground)
  • Window Exists - active when window matching specified expression exists in the system
  • Timer - periodically activates itself for specified duration
  • Message Subscription - activates/deactivates when specified message is received from EyeAuras webserver. Messages are separated by Channels and could be sent using SendMessage action
  • File Contains - activates when specified text is found in specified file
  • Telegram Subscription - activates/deactivates when specified message is received in Telegram channel
  • Volume Control - activates/deactivates when volume level of specified audio device or process reaches specified threshold
  • C# Script - custom scripts that use the latest version of C# language with full access to internal EyeAuras API. As soon as API will be stabilized there will be examples/docs.

Actions

  • Send - emulates user input - mouse movement, clicks, keyboard presses, etc. Supports multiple input methods starting from most basic ones that are used WinAPI and all the way to hardware-level emulation that uses Usb2Kbd physical device.
    • Input - generates single keyboard/mouse event
    • Text - inputs specified text either via clipboard or by typing each character individually
    • Sequence - replayed the specified sequence of keyboard presses, mouse clicks and mouse movements
  • Play Sound - plays specified sound
  • Win Activate - activates specified window
  • Delay - waits for some time before proceeding to the next action
  • Send To Telegram - sends message to Telegram channel
  • Send Message - sends network message through EyeAuras infrastructure to a specified Channel. All other instances of EyeAuras on other computers can subscribe and process these messages via Message Subscription trigger
  • C# Script - custom scripts that use the latest version of C# language with full access to internal EyeAuras API. As soon as API will be stabilized there will be examples/docs.

Overlays

  • Text - shows text, content could be modified either manually or using C# scripts
  • Image - shows an image, animated/transparent GIFs are supported
  • Replica - created a real-time visual clone of any specified window or its subregion. This allows you to clone parts of UI (e.g. bring cooldowns closer to the middle of you screen) or show downsized version of YouTube player while farming
  • Dependencies Viewer - debugging tool which could be used to check what states linked Auras have. Very useful for debugging complex models.
  • Custom UI - allows you to develop a full-blown custom user interface using combination of Microsoft Razor Pages (html+css+js) and C# to wire it all together inside EyeAuras