Difference between revisions of "TinMan Telepresence"

From Engineered Arts Wiki
Jump to navigation Jump to search
(Quickstart Instructions in brief - further screenshots to be added soon)
(Quickstart Instructions)
Line 37: Line 37:
  
  
One Logged in:
+
Once Logged in:
  
 
===Selecting Screen Size===
 
===Selecting Screen Size===

Revision as of 13:50, 20 September 2017

Telepresence

Overview

Telepresence is a feature that allows an operator to use a PC with headset and microphone to control Engineered Arts' robots like RoboThespian or SociBot and speak to people via the robot.

This allows for two way conversation with people who are stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.

A range of gestures, moods, and for Projected Face robots - different Guises (faces), can be triggered with a button press.

The operator can see what the robot sees and select the subject to talk to. The robot will maintain eye contact with the subject and move its head to keep them in view.

Telepresence Overview
  1. Operator (can be out of sight of subject)
  2. Microphone headset
  3. Touchscreen PC
  4. Robot RoboThespian shown
  5. Robot lipsyncs to your voice, says what you say, looks at subject
  6. Robot gestures with head and arm movements
  7. Subject speaking to robot

Hardware

  • All in one touchscreen PC supplied with microphone headset
  • Microphone headset recommended - Sennheiser GSP 350.
    • The closed cups block out external noise
    • It has excellent noise cancellation so you don't hear your own voice.
    • Please note that there is a volume dial on the right ear cup (so if audio sounds quiet - please also check the dial)

Quickstart Instructions

Logging in to Tinman (telepresence system)

Login with your username and password to https://telepresence.engineeredarts.co.uk

  • you can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot and then click on your robot to control it
Telepresence Website


Once Logged in:

Selecting Screen Size

  • Using the side menu it is possible to select your preferred screen format.
    • Original size
Viewing screen size selection, Original Size
  • Contain (Recommended)
Viewing screen size selection, Contain
  • Cover view
Viewing screen size selection, Cover View

Mute and Volume Controls

In this same menu its is possible to control the volume or mute the robot

  • Tap the mictorphone symbol to toggle mute on and off
  • When mute is on a red box will appear around the screen (viewers will now be unable to hear the operators voice, however the operator will be able to hear the voices of the viewers
User mute
  • Tap the microphone symbol near the robot face to toggle robot mic pick up on and off
  • Sliders control the sensitivity/volume of the mic pick up and volume of the viewer
Robot pick-up mute and volume slider
  • Tap the speaker symbol near the robot face to toggle robot speaker on and off
  • Sliders control the volume of the robot
Robot speaker mute and volume slider

Logging Out

  • Pressing the red up arrow in this side bar will log out of the robot
  • Pressing the grey right arrow or clicking anywhere on screen will close the side bar


Head Control

    • There are three simple ways to look around using Telepresence
  1. Click on screen where you require the robot to look
  2. The classic gamer's keyboard controls W, A, S, D also make the head look around
    • W - up, A - left, S - down, D - right
Click on screen to control head & classic gamer keyboard

3. Use the joy stick at the bottom left corner

Joystick head movement


Accessing Content

  • Content can be controlled using the wheel menu
click the wheel menu to access content
  • Content can be identified by different folder icons
content folders
  • Press (H) to show / hide text overlays and keyboard shortcuts on the buttons
Overlay shortcut

1. Songs

  • Classic RoboThespian songs as well as some especially created for Tinman
Songs

2. Impressions

  • Classic RoboThespian Impressions as well as some especially created for Tinman
Impressions

3. Faces

  • Happy, Angry, Sad and love are among the faces RoboThespian can use in this menu
Faces

4. Gestures

  • Waves, high five and shake hands as well as 'Rest Pose'
Gestures

5. Loops

  • Loops are used for giving presentations or talks, Talking loop, Listening loop. these sequences will continue until stopped.
Loops

6. One Liners

  • New quick content created especially for Tinman
One Liners

Playing a Sequence

  • click the sequence you wish the robot to perform
Selecting a sequence
  1. This icon shows the current sequence being played, sequences can be paused by pressing this icon
  2. The blue progression bar and count down timer are used to show how long the sequence is going to last
  3. The stop button will stop all sequences and return the robot to rest pose
  4. The robots dynamic face changes as he performs a sequence

Selecting sequences for use on quick menu

  • Favourite or commonly used sequences can be darg and dropped into quick access buttons at the bottom of the screen
Quick menu selection
  1. Select favourite or commonly used performance
  2. As you begin to drag a circle will appear along the bottom of the screen
  3. the sequence will now remain here until deleted
  • Sequences can be played and paused by clicking the icon
playing sequences on quick menu
  • The stop all function behaves as normal
stop all button
  • Sequences can be deleted from this menu by dragging them into the bin
deleting sequences from quick menu
  1. Drag the sequence from the button
  2. The stop button now becomes a bin
  • Depending on screen size up to 6 performances can exist on this menu at any time
multiple quick menu sequences

Using Face Detection

  • On the right of the screen is a slider menu
  • This menu allows you to toggle on/off face detection and auto wheel reset
  1. Face detection on/off
  2. Auto wheel reset on/off
enabling face detection & Auto wheel reset
  • Once face detection is active circles will appear over detected faces
  • Using the hot key (H) Gender and Age will appear next to the faces
Face detection active
  • Click on a person's face on the screen to track that person automatically with robot's eyes and head - the circle around their head will turn green to show they are being tracked
    • Please note that quick head movements may result in tracking being lost
    • Clicking on the screen elsewhere or using W,A,S,D will override this
Face detection active

Changing Eye Graphics

  • Change RoboThespian's eye graphics by clicking on the dynamic face in the top left corner
Face detection active
  • The eye graphic menu will open across the page
  • Select chosen eye graphic by clicking on the robots face
Face detection active
  • Current eye graphic will show on dynamic robot face
    • Note: eye graphics will stay this way until changed or a sequence is played
Face detection active

Once logged in:

  • Press H to show / hide text overlays and keyboard shortcuts on the buttons
  • Clicking anywhere on the screen makes the robot look at that point
  • The classic gamer's keyboard controls W, A, S, D also make the head look around
    • W - up, A - left, S - down, D - right
    • Tracking can be disabled if desired - click the three lines on the top right to open the options menu
  • Click the folder icon on the right to open folders of content, the icon with an infinity symbol is for looped content like talking / listening.
  • The other folders you should be able to guess, once a folder is open click on the performance you want - most are short, like one line film impressions.
  • Stop button at bottom stops current content playing
  • You can also drag your favourites from a folder down to the bottom of the screen for easy access.
  • The animation of the robots face in the corner is a real time representation of the robot's actual face, showing eyes, cheeks, and jaw movement
  • Click on the robot's face for a fly-out menu of different eye graphics, click on the desired eye graphic to change
Telepresence UI Overview
Telepresence UI Right Panel - Options

Audio:

  • Click the three lines on the top left to open the audio panel and access audio controls. The up arrow returns you to the list of robots.
  • We have had good results with this USB mic headset plugged into PC or laptop - Sennheiser GSP 350 Closed Back Gaming Headset - the closed cups block out external noise and it has excellent noise cancellation so you don't hear your own voice.
    • Please note that there is a volume control on the right ear cup (large round red nob) of the Sennheiser 350 headset. If audio sounds quiet - please check this as well.
Telepresence UI Left Panel - Volume Controls