Skip to content

Eye tracking software to send data to VRChat over OSC

Notifications You must be signed in to change notification settings

RxmTaco/TacoEyeTrack

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

59 Commits
 
 
 
 
 
 
 
 

Repository files navigation

TacoEyeTrack

VR eye tracking application for VRChat using OSC inspired by RedHawk989

eyetrack

lid_test

Install

Download latest version, extract, launch "TacoEyeTrack.exe"

Settings

  • Link cameras to left and right eyes (Link example: http://192.168.1.101) and save.
  • Go to "Cropping" tab and click and drag an area to be tracked.
  • Go to "Tracking" tab to start tracking.
  • In the "Tracking" tab, adjust the vertical Rotation sliders until the eyes are parallel, adjust Threshold slider so that the iris is visible and adjust the blob sliders to filter out potential unwanted blobs. Click on "Center" button to center the eyes.

Optional settings:

  • Option to enable hull tracking which will detect the circumference of the iris, if disabled the program will average all detected values (keeping disabled may be better if there is a lot of noise in the camera feed, enabled will be more accurate)
  • Smoothing iterations, higher means more smoothing but more delay, 0 = off
  • Eyelid detection (in development)

Parameters sent over OSC:

  • LeftEyeX (float)
  • LeftEyeY (float)
  • RightEyeX (float)
  • RightEyeY (float)
  • LeftEyeLid (int / bool)
  • RightEyeLid (int / bool)

(All OSC parameters can be changed from within the app as needed)

Default address for avatar parameters is /avatar/parameters/"parameter_name"

Float values range from -1 to 1 (this will be adjustable in a future update)

Blink values can be either sent as an integer (1 or 0) or boolean (true or false) depending how your avatar is set up.

Still a work-in-progress