The Eye Tribe

Hi Everyone,

I'm excited to announce the release of my first eye-controlled prototype game. You can download the version 1.0 exe, Unity project, source code, and assets from GitHub at: https://github.com/johnmquick/tetbeams. Feel free to modify, adapt, or build upon this project as noted in the license.

Please let me know if you make any adaptations or have questions regarding the project. I commented the code thoroughly to facilitate sharing. If you already have a TET device setup, the .exe should run and be ready for use immediately. You may also use the Unity project to experiment with individual scenes.

Thanks and enjoy,
John

Hi John,

Just tried the pre-compiled release and didn't go too well. First there was a blue-screen-of-death. Then it would start but just show a purple rectangle and then go gray.

Here's the log:

Initialize engine version: 4.3.4f1 (e444f76e01cd)
GfxDevice: creating device client; threaded=1
Direct3D:
Version: Direct3D 9.0c [nvd3dum.dll 9.18.13.3221]
Renderer: NVIDIA GeForce 210
Vendor: NVIDIA
VRAM: 978 MB (via DXGI)
Caps: Shader=30 DepthRT=1 NativeDepth=1 NativeShadow=1 DF16=0 INTZ=1 RAWZ=0 NULL=1 RESZ=0 SlowINTZ=0
Mismatched serialization in the builtin class 'Material'. (Read 32 bytes but expected 172 bytes)

(Filename: Line: 1173)

Begin MonoManager ReloadAssembly
Platform assembly: C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\UnityEngine.dll (this message is harmless)
Loading C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\UnityEngine.dll into Unity Child Domain
Platform assembly: C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\Assembly-CSharp.dll (this message is harmless)
Loading C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\Assembly-CSharp.dll into Unity Child Domain
Platform assembly: C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\Newtonsoft.Json.dll (this message is harmless)
Loading C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\Newtonsoft.Json.dll into Unity Child Domain
Platform assembly: C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\TETCSharpClient.dll (this message is harmless)
Loading C:\Users\Martin\Downloads\tetbeams-master\EyeTribe_Demo_TETBeams\Releases\v1-0\TETBeams_Data\Managed\TETCSharpClient.dll into Unity Child Domain
- Completed reload, in 0.037 seconds
Mismatched serialization in the builtin class 'Font'. (Read 84 bytes but expected 272 bytes)

(Filename: Line: 1173)

desktop: 2560x1440 59Hz; virtual: 4480x1440 at -1920,0
<RI> Initializing input.

<RI> Input initialized.
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 132324 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 8396 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 32844 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 120 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Shader'. (Read 20 bytes but expected 7364 bytes)

(Filename: Line: 1173)

Unsupported:
Mismatched serialization in the builtin class 'Material'. (Read 32 bytes but expected 112 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Shader'. (Read 20 bytes but expected 7560 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 72 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Shader'. (Read 20 bytes but expected 16316 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 352 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 652 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 360 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 364 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 360 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 356 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 376 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 620 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 188 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 272 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 264 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 272 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 468 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 464 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 468 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 464 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 468 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 460 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 372 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 620 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 188 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 992 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 988 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 360 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 360 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Texture2D'. (Read 60 bytes but expected 364 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 85 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 101 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 105964 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 192092 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 843656 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 4368 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 264688 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 3984460 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'AudioClip'. (Read 24 bytes but expected 107604 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 77 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 77 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 53 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 85 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 77 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 53 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 77 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 77 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 53 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 61 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'MonoScript'. (Read 25 bytes but expected 69 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Font'. (Read 84 bytes but expected 132952 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Font'. (Read 84 bytes but expected 117576 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Sprite'. (Read 80 bytes but expected 184 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Sprite'. (Read 80 bytes but expected 176 bytes)

(Filename: Line: 1173)
Mismatched serialization in the builtin class 'Sprite'. (Read 80 bytes but expected 180 bytes)

(Filename: Line: 1173)
The referenced script on this Behaviour is missing!

(Filename: Line: 1699)
A script behaviour has a different serialization layout when loading. (Read 24 bytes but expected 6992 bytes)
Did you #ifdef UNITY_EDITOR a section of your serialized properties in any of your scripts?

(Filename: Line: 1169)
Unsupported:
Unsupported:
The class defined in script file named '' does not match the file name!

(Filename: Line: 1615)
A script behaviour has a different serialization layout when loading. (Read 24 bytes but expected 40 bytes)
Did you #ifdef UNITY_EDITOR a section of your serialized properties in any of your scripts?

(Filename: Line: 1169)

The class defined in script file named '' does not match the file name!

(Filename: Line: 1615)
The class defined in script file named '' does not match the file name!

(Filename: Line: 1615)
The class defined in script file named '' does not match the file name!

(Filename: Line: 1615)
The class defined in script file named '' does not match the file name!

(Filename: Line: 1615)
A script behaviour has a different serialization layout when loading. (Read 24 bytes but expected 100 bytes)
Did you #ifdef UNITY_EDITOR a section of your serialized properties in any of your scripts?

(Filename: Line: 1169)
Couldn't load default font material!
(Filename: Line: 234)
Font size and style overrides are only supported for dynamic fonts.
(Filename: Line: 80)

Thanks, Martin.

As far as I can see, these messages are related to an unfixed Unity bug regarding asset serialization. However, based on the available information, I resaved the scenes and reimported all of the assets. A new v1-0 has been added to GitHub.

References:

• http://issuetracker.unity3d.com/issues/mismatched-serialization-in-the-builtin-class-mesh
• http://forum.unity3d.com/threads/210417-project-4-2-to-4-3-Mismatched-serialization-in-the-builtin-class-Mesh

Anyone who tries out the project, please let me know if the .exe works and whether the project compiles from Unity as well.

Thanks,
John

Thanks for making this.

I haven’t read up on how to use github yet.

I go here: tetbeams / EyeTribe_Demo_TETBeams / Releases / v1-0 / TETBeams.exe

I click on Raw, and download TETBeams.exe.

I get an error dialog:
Data folder not found
There should be 'TETBeams_Data'
folder next to the executable

I could be clicking on the wrong thing.

JeffKang wrote:Thanks for making this.

I haven’t read up on how to use github yet.

I go here: tetbeams / EyeTribe_Demo_TETBeams / Releases / v1-0 / TETBeams.exe

I click on Raw, and download TETBeams.exe.

I get an error dialog:
Data folder not found
There should be 'TETBeams_Data'
folder next to the executable

I could be clicking on the wrong thing.

Hi Jeff,

When Unity apps are shared in this manner, you must download both the Data folder and the .exe file. Therefore, this error should go away if you download the entire v1-0 folder. As long as the Data folder and the .exe are together, the .exe should run.

Thanks for testing it out.

John

That was really fun! The music pumped me up, lol.

It was super easy to hit the targets, so I thought that the rectangular bar that showed the charge was the area that your laser hits, but I noticed that the rectangular bar will snap to the nearest target.

Thanks again for making this.

JeffKang wrote:That was really fun! The music pumped me up, lol.

It was super easy to hit the targets, so I thought that the rectangular bar that showed the charge was the area that your laser hits, but I noticed that the rectangular bar will snap to the nearest target.

Thanks again for making this.

Thanks for your feedback. Luckily, the music was put into the public domain last year as part of an open bundle (http://open.commonly.cc/).

Indeed, the rectangular bar is where you are aiming your laser hits. It also indicates your charge level. The entire bar will position itself wherever you are looking on the screen (the bar is centered on your smoothed gaze coordinates).

If you want to adjust the difficulty, try altering the properties of the target prefabs in the Unity inspector and the wave definitions in the GameManager script. The system is setup to be fairly flexible when it comes to adjusting the target properties and the waves of targets.

John

Indeed, the rectangular bar is where you are aiming your laser hits

My mistake; it doesn’t snap. That just shows that I’m not used to how quick an eye controlled cursor moves.

Besides perceiving an initial snap to the target, I noticed that the rectangular bar was very smoothly following a target, which was another reason why I thought there was some sort of sticky effect. After forcing myself to fixate, I could see that there wasn’t.

Apparently, when you see a moving object, you naturally react more strongly to it (“Study Reveals that Movement Kicks Visual System into Higher Gear” – https://www.ucsf.edu/news/2014/03/11256 ... n%E2%80%99). I guess that I wasn’t aware that I was instinctively clinging to the targets.