TinMan Telepresence

From Engineered Arts Wiki
Revision as of 14:51, 20 September 2017 by Mtodd (talk | contribs) (Logging in to Tinman (telepresence system))
Jump to navigation Jump to search


Telepresence is a feature that allows an operator to use a PC with headset and microphone to control Engineered Arts' robots like RoboThespian or SociBot and speak to an audience via the robot.

This allows for two way conversation with an audience stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.

A range of gestures, moods, and for Projected Face robots - different Guises (faces), can be triggered with a button press.

The operator can see what the robot sees and can select a specific person to talk to. Robot lipsyncs to your voice and will maintain eye contact with that person and move its head to keep them in view.

The operator can be located remotely anywhere in the world.

Robot RoboThespian shown

Telepresence Overview


  • Recommend all in one touchscreen PC with good quality microphone headset
  • Microphone headset - recommend Sennheiser GSP 350.
    • The closed cups block out external noise
    • It has excellent noise cancellation so you don't hear your own voice.
    • Please note that there is a volume dial on the right ear cup (so if audio sounds quiet - please also check the dial)

Quickstart Instructions

Logging in to Tinman (telepresence system)

Login with your username and password to https://telepresence.engineeredarts.co.uk

You can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot. This will prevent audio feedback. Then, click on your robot to control it.

Telepresence Website

Once Logged in...

Select Video Stream Format

Click the menu button (3 lines) on the left to open the left side panel:

Left side panel button

Using the left side panel it is possible to select your preferred video format:

Original size:

Video Stream Format, Original Size

Contain view - Recommended - shows all of the robot's field of view:

Video Stream Format, Contain (recommended)

Cover view - zooms to fill screen - you might lose some of what the robot can see:

Video Stream Format, Cover

Audio Controls

The left side menu also contains the audio controls

  • Tap the microphone symbol to toggle mute on or off
  • When muted a red box will appear around the screen - audience will now be unable to hear the operator's voice, however the operator will be able to hear the audience:
User mute

  • Tap the microphone symbol near the robot face to toggle robot's microphone on or off. When robot's microphone is off the operator will not hear the audience. However the audience may still hear the operator!
  • The slider controls the gain (sensitivity) of the robots microphone.
  • Use your PC / laptop audio controls to set headphones to a comfortable volume
  • If using the Sennheiser GSP 350 headset please note that there is a volume dial on the right ear cup (so if all audio sounds quiet please check the volume dial)
Robot pick-up mute and volume slider

  • Tap the speaker symbol near the robot face to toggle robot speaker on or off
  • The slider controls the volume of the robot's torso speaker
Robot speaker mute and volume slider

Logging Out

  • When finished with a telepresence session press the red up arrow in the left side panel to log out of the robot and return to the robot selection screen

Closing the Left Side Panel

  • Press the grey right arrow or click anywhere on screen to close the left side panel

Head Control

There are three simple ways to look around using Telepresence
1. Click on screen where you want the robot to look
2. The classic gamer's keyboard controls W, A, S, D also make the head look around
W - up, A - left, S - down, D - right:

Click on screen to control head & classic gamer keyboard

3. Use the joy stick at the bottom left corner:

Joystick head movement

Accessing Content

  • Content can be accessed and triggered using the wheel menu:
click the wheel menu to access content

  • Content is arranged in folders on each segment of the wheel, identified with icons:
content folders

  • Press (H) on your keyboard to show / hide text overlays and keyboard shortcuts on the buttons:
Overlay shortcut

1. Songs:

  • Classic RoboThespian songs as well as some especially created for Tinman:

2. Impressions

  • Classic RoboThespian Impressions as well as some especially created for Tinman:

3. Faces

  • Happy, Angry, Sad and love are among the faces RoboThespian can use in this menu:

4. Gestures

  • Waves, high five and shake hands as well as 'Rest Pose':

5. Loops

  • Loops are used for giving presentations or talks, Talking loop, Listening loop. these sequences will continue until stopped:

6. One Liners

  • New quick content created especially for Tinman:
One Liners

Playing a Sequence

  • click the sequence you wish the robot to perform:
Selecting a sequence

  1. This icon shows the current sequence being played, sequences can be paused by pressing this icon
  2. The blue progress bar and count down timer are used to show how much time until the sequence finishes
  3. The stop button stops all sequences and returns the robot to rest pose
  4. The robots dynamic face changes as he performs a sequence

Selecting sequences for use on quick menu

  • Favourite or commonly used sequences can be drag and dropped into quick access buttons at the bottom of the screen:
Quick menu selection

  1. Select favourites or frequently used performances
  2. As you begin to drag a circle will appear along the bottom of the screen
  3. the sequence will now remain here until deleted
  • Sequences can be played and paused by clicking the icon:
playing sequences on quick menu

  • The stop all function behaves as normal:
stop all button

Sequences can be deleted from this menu by dragging them into the bin

  1. Drag the sequence from the button
  2. The stop button now becomes a bin
deleting sequences from quick menu

  • Depending on screen size up to 6 performances can exist on this menu at any time
multiple quick menu sequences

Using Face Detection

Click the menu button (3 lines) on the right to open the right side panel

  • This panel allows you to toggle on/off face detection and auto wheel reset:
opening menu

  1. Face detection on/off
  2. Auto wheel reset on/off
enabling face detection & Auto wheel reset

  • Once face detection is active circles will appear over detected faces
  • Using the hot key (H) Gender and Age will appear next to the faces
Face detection active

  • Click on a person's face on the screen to track that person automatically with robot's eyes and head - the circle around their head will turn green to show they are being tracked
    • Please note that quick head movements may result in tracking being lost
    • Clicking on the screen elsewhere or using W,A,S,D will override this
Face detection active

Changing Eye Graphics

  • Change RoboThespian's eye graphics by clicking on the dynamic face in the top left corner
Face detection active

  • The eye graphic menu will open across the page
  • Select chosen eye graphic by clicking on the robots face
Face detection active

  • Current eye graphic will show on dynamic robot face
    • Note: eye graphics will stay this way until changed or a sequence is played
Face detection active