Telepresence

From Engineered Arts Wiki
Jump to: navigation, search
Telepresence

Overview

Telepresence is a feature that allows an operator to use a PC with headset and microphone to control Engineered Arts' robots like RoboThespian or SociBot and speak to an audience via the robot.

This allows for two way conversation with an audience stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.

A range of gestures, moods, and for Projected Face robots - different Guises (faces), can be triggered with a button press.

The operator can see what the robot sees and can select a specific person to talk to. Robot lipsyncs to your voice and will maintain eye contact with that person and move its head to keep them in view.

An inset view shows the robot's face in real time - you can see exactly the current expression, guise (for SociBot), eye type and where the robot is looking.

The operator can be located remotely anywhere in the world where there is an internet connection.

Robot RoboThespian shown.

Telepresence Overview

Hardware

  • Recommend all in one touchscreen PC with good quality microphone headset
  • Microphone headset - recommend Sennheiser GSP 350.
    • The closed cups block out external noise
    • It has excellent noise cancellation so you don't hear your own voice.
    • Please note that there is a volume dial on the right ear cup (so if audio sounds quiet - please also check the dial)

TinMan Diagram.png

Quickstart Instructions

Logging in to Tinman (telepresence system)

Login with your username and password to https://telepresence.engineeredarts.co.uk

You can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot. This will prevent audio feedback. Then, click on your robot to control it.

Telepresence Website


Once Logged in...

Select Video Stream Aspect Ratio

Click the "hamburger" menu button (3 lines) on the left to open the left side panel:

Left side panel button


Using the left side panel it is possible to select your preferred video aspect ratio:

Original size:

Video Stream Format, Original Size


Contain view - Recommended - shows all of the robot's field of view:

Video Stream Format, Contain (recommended)


Cover view - zooms to fill screen - you might lose some of what the robot can see:

Video Stream Format, Cover

Audio Controls

The left side menu also contains the audio controls

  • Tap the microphone symbol under the human face to toggle mute on or off. This will mute the operator's microphone
  • When muted a red box will appear around the screen - audience will now be unable to hear the operator's voice, however the operator will be able to hear the audience:
User mute


  • Tap the microphone symbol near the robot face to toggle robot's microphone on or off. When robot's microphone is off the operator will not hear the audience. However the audience may still hear the operator!
  • The slider controls the gain (sensitivity) of the robots microphone.
  • Use your PC / laptop audio controls to set headphones to a comfortable volume
  • If using the Sennheiser GSP 350 headset please note that there is a volume dial on the right ear cup (so if all audio sounds quiet please check the volume dial)
Robot pick-up mute and volume slider


  • Tap the speaker symbol near the robot face to toggle robot speaker on or off
  • The slider controls the volume of the robot's torso speaker
Robot speaker mute and volume slider

Logging Out

  • When finished with a telepresence session press the red up arrow in the left side panel to log out of the robot and return to the robot selection screen.

Closing the Left Side Panel

  • Press the grey right arrow or click anywhere outside of the left side panel to close it.

Head Control

There are three simple ways to look around using Telepresence
1. Click on screen where you want the robot to look
2. The classic gamer's keyboard controls W, A, S, D also make the head look around
W - up, A - left, S - down, D - right:

Click on screen to control head & classic gamer keyboard


3. Use the joy stick at the bottom left corner. Drag the centre circle in the direction you want the head to travel. The further you drag the stick, the faster the head will move :

Joystick head movement

Accessing Content

  • Content can be accessed and triggered by clicking the wheel menu:
click the wheel menu to access content


  • Content is arranged in folders on each segment of the wheel, identified with icons:
content folders


  • Press (H) on your keyboard to show / hide text overlays and keyboard shortcuts on the buttons:
Overlay shortcut


1. Songs:

  • Classic RoboThespian songs as well as some specially created for Tinman:
Songs


2. Impressions

  • Classic RoboThespian Impressions as well as some especially created for Tinman:
Impressions


3. Faces

  • Happy, Angry, Sad and love are among the faces RoboThespian can use in this menu:
Faces


4. Gestures

  • Waves, high five and shake hands as well as 'Rest Pose':
Gestures


5. Loops

  • Loops are used for giving presentations or talks, Talking loop, Listening loop. these sequences will continue until stopped:
Loops


6. One-Liners

  • New quick content created, especially for TinMan. Like the impressions but snappier:
One Liners

Playing a Sequence

  • click the sequence you wish the robot to perform:
Selecting a sequence


  1. This icon shows the current sequence being played, sequences can be paused by pressing this icon
  2. The blue progress bar and count down timer are used to show how much time until the sequence finishes
  3. The stop button stops all sequences and returns the robot to rest pose
  4. The robots face provides a real-time preview of the robot's face

Selecting Favourite Sequences for use on quick menu

  • Favourite or commonly used sequences can be drag and dropped into quick access buttons at the bottom of the screen:
Quick menu selection


  1. Select favourites or frequently used performances
  2. Click and drag, and as you begin to drag a circle will appear along the bottom of the screen
  3. Drag the sequence into the circle, and the sequence will now remain here until deleted
  • Sequences can be played and paused by clicking the icon:
playing sequences on quick menu


  • The stop all function behaves as normal:
stop all button


Sequences can be deleted from this menu by dragging them into the bin (Sequences will still be available in the wheel menu)

  1. Drag the sequence from the button
  2. The stop button now becomes a bin. Dropping here will remove it from the favourites.
deleting sequences from quick menu


  • Depending on the screen size up to 6 performances can exist on this menu at any time. Each can be triggered by number keys 1-6 respectively.
multiple quick menu sequences

Using Face Detection

Click the "hamburger" menu button (3 lines) on the right to open the right side panel

  • This panel allows you to toggle on/off face detection and auto wheel reset:
opening menu


  1. Face detection on/off
  2. Auto wheel reset on/off
enabling face detection & Auto wheel reset


  • Once face detection is active circles will appear over detected faces.
  • Blue Dotted Circle = Face Detected ; Yellow Dashed Circle = Looking at Face; Green Solid Circle: Face Manually Selected
  • Using the hot key (H) Gender and Age will appear next to the faces
Face detection active


  • Click on a person's face on the screen to track that person automatically with robot's eyes and head - the circle around their head will turn green to show they are being tracked
    • Please note that quick head movements may result in tracking being lost
    • Clicking on the screen elsewhere or using W,A,S,D will override this
Face detection active

Changing Eye Graphics

  • Change RoboThespian's eye graphics by clicking on the dynamic face in the top left corner
Face detection active


  • The eye graphic menu will open across the page
  • Select chosen eye graphic by clicking on the robots face
Face detection active


  • Current eye graphic will show on dynamic robot face
    • Note: eye graphics will stay this way until changed or a sequence is played
Face detection active