ECTtracker

ferelrew - Eyecomtec.Com

Le téléchargement nécessite un accès à la bibliothèque YouScribe
Tout savoir sur nos offres

41 pages

English

Le téléchargement nécessite un accès à la bibliothèque YouScribe
Tout savoir sur nos offres

A propos
Informations
Extrait

Description

https://eyecomtec.com/80-ECTtracker
ECTtracker (EyeComTec Tracker) is an eye-tracking software which identifies visible actions performed by the user. It is mainly used to monitor the state of the user’s eyes (open or closed) but can also track the eyebrows or mouth.

Informations

Publié par	ferelrew
Publié le	09 août 2015
Nombre de lectures	0
Langue	English
Poids de l'ouvrage	2 Mo

Extrait

1|Krokoz™

ECTtracker v15.4.x User Guide

About ECTtracker ECTtracker(EyeComTec Tracker) is an eye-tracking software which identifies visible actions performed by the user. It is mainly used to monitor the state of the user’s eyes (open or closed) but can also track the eyebrows or mouth. This software can be used in conjunction with different video capturing applications for web cameras or other devices connected to a PC (e.g.ECTcamera, Skype, Media Player Classic).ECTtrackercompares different states of the user's eyes with assigned key codes, which can be further transmitted to any receiving application (ECTmorse,ECTkeyboardand many others). Software is extremely flexible and adjustable, as well as portable, and can be personalized for use for any specific user and the performance of a computer. In fact,ECTtrackeris an alternative to smart computer vision realization. Unlike many others similar in functionality programs,ECTtrackeranalyzes images using a special Matrix of Samples, which is unique for any specific user and environment (camera position, illumination, etc.). The program can be used by fully paralyzed patients and those who suffer from some form of impaired mobility.ECTtrackerprovides assured tracking of visible activity, even for those patients with physical damages of their face, injuries, burns and other post-operative/accidental states. The software is fully customizable. The user can set an image recognition structure, matching levels between images and samples, video processing speed (in frames per second), idle time for cases when there's no image, and there are also emulated key codes to be transmitted into third-party receiving applications. The software contains more than 45 different parameters, which can be used to change appearance and functionality ofECTtracker. Some parameters allow the user to lower computing requirements, providing stable work even on computers with low performance levels. ECTtrackerhas convenient interface and reach functionality for proper and precise setting and debugging. Initial setting procedure is simple due to its auto-calibration feature. Furthermore,ECTtrackersupports various localizations, allowing patients to use the software in their own language. ECTtrackeris a highly practical and convenient application due to its ability to adapt to the physical condition of the user, different environments and computer system resources. A flexible setting process and an unlimited amount of user accounts makes it possible to use the application in any case.

(fig. 1. Main interface of the program) You can see the standard interface ofECTtrackeron the image above. The numbers show various elements of the interface: 1–main window ofECTtracker, which shows the processed part of an image, coordinate tracking net and statistic fields; 2–grab-form, or so-called "target window" which allows the application to capture part of the image for analysis. In this example, grab-form is located above the active window ofECTcamera–the application for video streaming; 3–the Matrix of Samples–the special table of theECTtrackerapplication, which contains small snapshots showing the user’s eyes in different states (both eyes open, closed, or only one eye is open). During its operation the software compares samples and the current image identifying the user’s state of eyes. 4–debug window with graphic indicators. By changing the color of the stripe, the software clearly shows which sample corresponds with the acquired image. This window is used during the initial setting of ECTtrackerand during determination of tracking quality; 5–program log, which contains information about all the important actions and events. The log contains the date and time of tracking start and stop, structure selection and other data. All the information can be exported to a text file; 6–theECTtrackersettings window, which contains all the parameters with a short description for each.

(Fig. 1. The main interface of the program; with an alternative placement of elements)

Advantages of using of ECTtracker ECTtracker has a number of significant advantages over other software solutions with similar functionality: adaptation of the program to specific needs and the physical condition of each individual user. ECTtrackerwork with both fully paralyzed patients and patients with various disorders of can motor activity; perfect trainability. The program allows you to work in any environment: camera position, lighting, and user position.ECTtrackertracks eye state by comparing it with saved samples, providing high quality of tracking and stable work; unlimited amount of configurations. The program makes it possible to save configurations into separate files and switch between them quickly when needed. The small size of such files allows ease of storing them on any portable device and share using e-mail; portability and small size of the program allows running it from any external media device. ECTtracker does not require installation and does not make changes to the registry of the operating system; rich customizability and average technical requirements.ECTtrackerprovides stable work, even on computers with low performance, due to high configurability of tracking algorithms and graphical user interface; localizations. The program supports various languages of interface, which provides high level of comfort and allows users to work using their own language; simple and intuitive interface allows users to quickly familiarize with the program and change all settings easily. The main feature ofECTtrackeris the adaptation to the physical abilities of the user. The program can be used by both fully paralyzed patients and those who suffer from uncontrollable muscular activity (tremors, tics, etc.). In case of contrast marker usage,ECTtrackerprovides excellent quality, even for those patients with physical damages to the face: wounds, burns, singed eyelashes, postoperative eye conditions, and so on. The program has the ability to change the matching level between analyzed images and samples, as well as offering a wide selection of structures and other parameters which allow the user to adjust ECTtracker for their specific needs and provides optimal tracking results. The favorable difference ofECTtrackercomparison with similar software is its perfect in trainability, which allows users in any state to work with the program. The tracking algorithm of ECTtrackerindependently to the position of the user, lighting or technical parameters of the works computer. Nowadays most algorithms are made to be universal and normally their analysis is based on finding light and dark areas of the image, whileECTtrackerallows creating a base of samples for tracking, which are unique for any user and environment (lighting or camera position). Such high level of trainability provides high quality of tracking in almost any case. ECTtracker keeps working, where other solutions fail (unable to identify human face or track eyes). As a result, the user can work with a virtual keyboard more confidently and faster, becoming less stressed at the same time. Furthermore,ECTtrackerallows the user to enter symbols not only by eye blinking, but with any clearly visible movement or gesture. This feature can be used by patients suffering from most known types of physical disabilities. All changes of settings performed by user can be saved as separate configuration files, making it possible to change such files "on the fly", allowing different users to work on the same machine. Recognition structures and personal settings are adjusted for specific needs of each user. The program allows creation of an unlimited amount of settings profiles, while small sizes of files allows ease of sending them through email or share in other ways.

Portability and the small size of the program allows ease of running ECTtracker from any external media device. ECTtracker does not require installation and does not make changes to the registry of the operating system. Information fields of the main window of the program, an additional debugging window and a detailed event log are handy features for fine-tuning. Simultaneously, all debugging elements can be disabled during normal operation of the program. The ability to reduce the amount of processed frames per second can reduce the load on the processor and other system resources of the computer. This allows adjusting ECTtracker for comfortable and smooth operation, even on computers with low performance. A simple and user-friendly interface allows performing initial configurations quickly and begin working immediately withECTtracker. All the basic functionality of the main menu is duplicated with "hot keys" for quick access. In addition, ECTtracker supports different localizations, allowing users to work with the program in their native language. Configuration ofECTtracker does not take long. In case of change in light conditions or body position, the user can quickly create new samples for tracking by using the auto-calibration feature. There is no need to delete old samples, because the program allows an unlimited amount of settings profiles and several Matrix of Samples. All these features provide extreme flexibility in configuration and operation ofECTtracker.

ECTtracker Getting Started (First Run) In order to provide a proper analysis of the image by program, it is necessary to first calibrate it and fill the Matrix of Samples. It is also necessary to change several parameters depending on the physical characteristics of the patient and performance of the computer. This is especially important during the first start of the application. The initial setting procedure ofECTtracker and further work with the program includes the following stages: 1.Starting the program, loading user settings if necessary. 2.Selection of recognition structure. 3.Image source setting and grab-form positioning (the user manual will describe the setting and use of ECTtrackerin conjunction withECTcamera). 4.Automatic or manual calibration ofECTtracker(filling the Matrix of Samples). 5.Setting any receiving programs, assigning key codes and actions, as well as some additional parameters. Starting the program and selection of recognition structure To begin working with the program you need to launch the eye-tracking application by opening the ECTtracker.exe file. If you need to use a previously saved settings profile then you should select "Profile"– "Load Settings" menu item after starting the program and choosing the desired cfg-file in the window of the program (see fig. 2). All changes are applied after selecting a new configuration file.

(fig. 2. Loading configuration file for ECTtracker) After doing so (only if it is necessary, because the type of recognition structure is already predefined in the selected configuration file) you have to select the recognition structure–for one eye only or for both eyes. Selection can be done through choosing "Samples" - "Open Structure" menu items. Recognition structures differ in positions of key points, which are used during comparison of saved samples and current frames from the video source. Different structures are shown in figure 3. We have to also mention that Copyright © 2000- 2015 EyeComTec.Com͞LAZgroup SA͟Page8All rights reserved.

different structures allow us to identify user selection - not only by eye state, but by using other actions. Such actions include eyebrows or lips movements, finger moving away from the source image and bringing it back in to the image after a short while - in other words, they include any clearly different states of one object. Here, and after in this manual, we focus primarily on the tracking of the eyes, since in most cases this organ remains capable of performing visible actions.

(fig. 3. Different recognition structures) The main principle for structure selection is to put the maximum amount of key points above any fragment of the image with a maximum amount of visually distinguishable changes. The key points of the structure, located above the static area of the frame, increase total load on the system and negatively affect tracking quality. Selecting image source and setting up grab-form Before tracking, you will have to predefine the image source inECTtracker. If the program is used with software which acquires video from a web camera or any other device, this software will have to be started first. If the program works with already recorded video, it is necessary to open the media player window first. This user manual describesECTtracker andECTcamera software working in conjunction. ECTcamera is an application, intended to use with a web camera on a laptop or any removable camera which can be connected to a personal computer. To provide the correct display of the video fragment from theECTcamerawindow, it is necessary to place the target window (grab-form) in the correct way. During the launch ofECTtrackeryou can see a separate black rectangle -a ”target window” (also called a grab-form), which is intended for video capturing and transmitting frames into the program. To set up video capturing it is necessary to move the target window above the source application showing the video (see fig. 4). Please note that in the video window of ECTtracker the key points of the structure have to cover the maximum possible changeable area of the displayed image.

(Fig. 4. Capturing video fragment using target window) After structure selection and correct setting of the grab-form above the captured image, a table with samples for program operation and correct image tracking must be either created or loaded. If a table has been previously created, it can be loaded by using:

a)"Samples"–"Load Matrix of Samples" menu items, in case the Matrix of Samples was saved as one file; b)"Samples"– "Import Matrix of Samples" menu items, in case all samples were exported as separate files. If there is no Matrix of Samples created, this has to be created in manual mode or by using the automatic calibration feature. Automatic calibration Automatic calibration involves script, which shows auxiliary images with various eye states (both eyes open, only right eye open, only left eye open, both eyes closed). You will have to follow such images and close one or both eyes in accordance with the image on the screen. Different examples of such images are shown in figure 5 below.

(fig. 5. Auxiliary images for automatic calibration) In accordance with the selected script, images are going to be shown in different parts of the screen. Imagine that the screen is divided into 9 different regions, and each corresponds to one possible gaze-point of the user (see fig. 6). The program will create different samples for each position and eye state. Such a method is necessary for the program to work correctly, regardless of which part of the screen you are looking at.

(fig. 6. Various positions of auxiliary icons) Parameter 48 of theECTtrackersettings panel allows a file to be selected with an auto-calibration script. Functionality of scripts can be determined by the name of the file because it contains a special symbol encoding. The number before ‘S’ is the quantity of eye states that are going to be displayed during the auto-calibration. The number before ‘P’ is the quantity of different positions of the icon on the screen. And the number before ‘M’ is the quantity of rows in the Matrix of Samples1st example: if you select Eye_2S5P2M.dat script, you will see icons with open and closed eyes. The icon is going to be shown in 5 different screen positions (center, upper left corner, upper right corner, lower left corner and lower right corner). Calibration will fill 2 rows of the Matrix of Samples.

2nd example: if you select Eye_4S5P4M.dat script, you will see icons with four possible states of eyes (both eyes open, right eye open, left eye open, both eyes closed). The icon is going to be shown in 5 different screen positions. Calibration will fill 4 rows of the Matrix of Samples. Thus, it is possible to select the type of auto-calibration that fits the needs of the user, for example, if the user can move only one eye, it can be useful to load the script that provides two sample types - one open eye and one closed eye (in such case you have to put the grab-form only above one working eye). If the user can blink with both eyes, then it can be useful to load the script for 4 eye states. To start the calibration process, select "Samples"– "Autocalibration" menu item or press theF6 button. You will see images with a countdown timer sequentially. There is a sound at the end of each time, after which the program saves the sample and goes to the next image. The calibration procedure allows creating the Matrix of Samples in fully automatic mode. Some results of auto-calibration may not have good quality due to: significant image shift after head movement, if the user is able to move their head; indistinct pictures due to eye movement, blinking, head rotation, etc.; graphic artifacts and shadows in case of insufficient lighting from the camera. In such cases you can erase the Matrix of Samples using "Samples"– "Erase Matrix of Samples" menu item, and re-calibrate, providing proper conditions for the process. Manual Calibration You can select samples for the Matrix of Samples in manual mode. Using this feature you can replace samples of bad quality received during auto-calibration, without re-calibration. When possible, it is recommended to select all samples in the manual mode. The Matrix of Samples ofECTtrackercan be filled using two ways: 1.(usually 2 samples are enough when the program set up correctly),Create samples with a closed eye add them into the first row of the Matrix of Samples. Create a sample with an open eye (one sample is enough) and add it to the second row of the Matrix of Samples. Then specify key codes and action codes (press or release) by filling in parameters 60 and 61 of the settings panel. By default, parameter 60 has "32 1" value, which means "press space button" and parameter 61 has "32 2" which means "release space button". You can find more information about key codes and actions in the "Settings and additional parameters ofECTtracker" sectionof this manual. 2.Create a sample for a closed eye and add it to the second row of the Matrix of Samples. Set the key code and action code by filling in parameter 61 (by default it has "32 1" value, which means "press space button"). Specify a value for parameter 59 (by default it has "32 2" value, which means "release space button"). Parameter 59 predefines the key code and action code in caseECTtrackeris not able to find at least one corresponding sample. Therefore, the program can work using only one sample with an open eye! This feature simplifies the operation ofECTtrackerand speeds up the initial settings process. To begin creating the Matrix of Samples, thetracking process has to be running. The tracking can be launched by clicking on the "Start" menu item or by pressing theF11button. Calibration should be done using the mouse. To select a potential sample, right-click on the video screen. Doing this will freeze it at the current frame. Note that the created sample is always centered around the point of the click (see fig. 7). Another right-click on the image insideECTtrackerwindow will update the current frame. Left click will cancel the selection and enable the video capturing process again. Copyright © 2000- 2015 EyeComTec.Com͞LAZgroup SA͟Page11All rights reserved.