Difference between revisions of "TinMan Telepresence"

From Engineered Arts Wiki
Jump to navigation Jump to search
 
(130 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
[[Category:Telepresence]]
 
[[Category:Telepresence]]
−
[[Category:User Manual]]{{headerthumb|File:main_telepresence.jpg|Telepresence|link=}}
+
[[Category:User Manual]]
 +
[[Category:Software]]{{headerthumb|File:untitled-31.jpg|Telepresence|link=}}
 
==Overview==
 
==Overview==
 +
TinMan Telepresence is a feature that allows an operator to use a PC with headset and microphone to control Engineered Arts' robots like [[RoboThespian]] or Mesmer and speak to an audience via the robot.
  
−
Telepresence is a feature that allows an operator to use an Android tablet with headset and microphone to control Engineered Arts' robots like [[RoboThespian]] or [[SociBot]] and speak to people via the robot.  
+
This allows for two way conversation with an audience stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.
  
−
This allows for two way conversation with people who are stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.
+
A range of gestures, moods, and for [[Projected Face]] robots - different [[Guises|Guises (faces)]], can be triggered with a button press.
  
−
A range of gestures, moods, and for [[Projected Face]] robots - different [[Guises|Guises (faces)]], can be triggered with a button press. You can even customise what the buttons do.
+
The operator can see what the robot sees and can select a specific person to talk to. Robot lipsyncs to your voice and will maintain eye contact with that person and move its head to keep them in view.
  
−
The operator can see what the robot sees and select the subject to talk to.  The robot will maintain eye contact with the subject and move its head to keep them in view.
+
An inset view shows the robot's face in real time - you can see exactly the current expression, guise (for SociBot), eye type and where the robot is looking.
  
−
[[File:800_telepresence_setup.png|thumb|none|800px|link=|Telepresence Overview]]
+
The operator can be located remotely anywhere in the world where there is an internet connection.
  
−
# Operator (can be out of sight of subject)
+
Robot [[RoboThespian]] shown.
−
# Microphone headset
 
−
# Android tablet
 
−
# Robot [[RoboThespian]] shown
 
−
# Robot lipsyncs to your voice, says what you say, looks at subject
 
−
# Robot gestures with head and arm movements
 
−
# Subject speaking to robot
 
  
 +
[[File:Untitled-31.1.jpg|thumb|none|1024px|link=|Telepresence Overview]]
  
−
==Tablet and Hardware==
+
==Hardware==
−
Android tablet - currently [https://www.asus.com/uk/Tablets/Nexus_7_2013/ Google Nexus 7], supplied with microphone headset
+
* Recommend touchscreen PC with good quality microphone headset
 +
* Microphone headset - recommend Sennheiser GSP 350.
 +
** The closed cups block out external noise
 +
** It has excellent noise cancellation so you don't hear your own voice.
 +
** Please note that there is a volume dial on the right ear cup (so if audio sounds quiet - please also check the dial)
 +
[[File:TinMan_Diagram.png]]
  
−
[[File:800_telepresence_tablet_hardware.png|thumb|none|800px|link=|Telepresence Tablet and Hardware]]
+
===Touchscreen PC supplied by Engineered Arts===
 +
If you have opted for an touchscreen PC supplied by Engineered Arts please see [[Telepresence - touchscreen PC]]
  
−
* {{num|1}} [https://www.asus.com/uk/Tablets/Nexus_7_2013/ Google Nexus 7]
+
==Quickstart Instructions==
−
* {{num|2}} 3.5mm headphone jack with adapter for microphone headset plugged in
+
===Logging in to TinMan telepresence system===
−
* {{num|3}} Microphone headset adaptor
+
Login with your username and password to https://telepresence.engineeredarts.co.uk
−
* {{num|4}} Microphone headset
 
−
* {{num|5}} Microphone part of headset
 
−
* {{num|6}} Micro USB connector with charger plugged in
 
−
* {{num|7}} Tablet charger
 
  
 +
You can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot. This will prevent audio feedback. Then, click on your robot to control it.
  
−
===Power and volume controls===
+
[[File:untitled-34.jpg|thumb|none|1024px|link=|Telepresence Website]]
−
[[File:800_telepresence_tablet_hardware_controls_v2.png|thumb|none|800px|link=|Telepresence Tablet Power and Volume Hardware Buttons]]
 
  
−
* {{num|8}} Power button - hold for a couple of seconds to power on the tablet
 
−
* {{num|9}} Volume rocker (up) - press the upper part of the volume rocker to increase tablet volume
 
−
* {{num|10}} Volume rocker (down) - press the lower part of the volume rocker to decrease tablet volume
 
  
−
Please also make sure the tablet volume {{num|9}} is set to maximum for the best experience with telepresence. ''Please take care if you use any other apps on the tablet, that may be much louder! You can reduce the volume for other apps.''
+
Once Logged in...
  
−
===Connecting the microphone headset===
+
===Select Video Stream Aspect Ratio===
−
[[File:800_telepresence_tablet_mic_headset_connections.png|thumb|none|800px|link=|Microphone Headset Adapter Connections]]
+
Click the "hamburger" menu button (3 lines) on the left to open the left side panel:
 +
[[File:Untitled-32.jpg|thumb|none|1024px|link=|Left side panel button]]
  
−
* {{num|21}} headset headphones jack plug (green), plugs into {{num|22}}
 
−
* {{num|22}} headphones socket on adaptor cable, [[File:headphones.png|24px]] symbol or similar on socket
 
−
* {{num|23}} headset microphone jack plug (pink), plugs into {{num|24}}
 
−
* {{num|24}} microphone socket, [[File:mic.png|12px]] symbol or similar on socket
 
  
 +
Using the left side panel it is possible to select your preferred video aspect ratio:
  
−
==Starting Telepresence==
+
Original size:
−
If you haven't already, power on your robot and power on the tablet.
+
[[File:Untitled-1.3.jpg|thumb|none|1024px|link=|Video Stream Format, Original Size]]
  
−
From the home screen, press on the EA Telepresence icon {{num|1}}. 
 
  
−
This will take you to the login screen. Enter your username {{num|2}} and password {{num|3}} as supplied by Engineered Arts and then hit Login {{num|4}} .
+
Contain view - '''Recommended''' - shows all of the robot's field of view:
 +
[[File:Untitled-2.2.jpg|thumb|none|1024px|link=|Video Stream Format, Contain (recommended) ]]
  
−
[[File:1443-EA-Telepresence-icon.png|thumb|none|800px|link=|EA Telepresence Icon]]
 
−
[[File:1443-EA-Telepresence-login.png|thumb|none|800px|link=|EA Telepresence Login]]
 
  
 +
Cover view - zooms to fill screen - you might lose some of what the robot can see:
 +
[[File:Untitled-3.2.jpg|thumb|none|1024px|link=|Video Stream Format, Cover]]
  
−
Once logged in you will see the Telepresence Robots status page:
+
===Audio Controls===
 +
The left side menu also contains the audio controls
  
−
[[File:1443-EA-Telepresence-system-status.png|thumb|none|800px|link=|EA Telepresence System Status]]
+
* Tap the microphone symbol under the human face to toggle mute on or off. This will mute the operator's microphone
 +
* When muted a red box will appear around the screen - audience will now be unable to hear the operator's voice, however the operator will be able to hear the audience:
 +
[[File:Untitled-4.2.jpg|thumb|none|1024px|link=|User mute]]
  
−
* {{num|6}} System Status shows whether the Telepresence system is Online {{num|7}} or Offline
 
−
* {{num|8}} List of robots you can access with your Telepresence account. In this example [[RoboThespian]] with [[Serial_Number_Identification| Serial Number]] rt-0096.
 
−
* {{num|9}} Robot's status:
 
−
** Online - available for Telepresence
 
−
** Offline - Telepresence is not available (you may be out of wifi range of the robot's router, or Telepresence is not enabled on the robot)
 
−
** Busy - another user is logged into Telepresence
 
  
−
Click on your robot in the list to begin controlling it
+
* Tap the microphone symbol near the robot face to toggle robot's microphone on or off.  When robot's microphone is off the operator will not hear the audience. However the audience may still hear the operator!
 +
* The slider controls the gain (sensitivity) of the robots microphone.
 +
* Use your PC / laptop audio controls to set headphones to a comfortable volume
 +
* If using the Sennheiser GSP 350 headset please note that there is a volume dial on the right ear cup (so if all audio sounds quiet please check the volume dial)
 +
[[File:Untitled-5.1.jpg|thumb|none|1024px|link=|Robot pick-up mute and volume slider]]
  
  
−
==Telepresence Controls Overview==
+
* Tap the speaker symbol near the robot face to toggle robot speaker on or off
−
===Main Controls===
+
* The slider controls the volume of the robot's torso speaker
−
[[File:1443-EA-Telepresence-main-controls.png|thumb|none|800px|link=|EA Telepresence Main Controls]]
+
[[File:Untitled-6.1.jpg|thumb|none|1024px|link=|Robot speaker mute and volume slider]]
  
−
* {{num|1}} Open / Close [[#Left Side Panel: Volume Controls, and Settings switches|left side panel]]: Volume Controls, and Settings switches
+
===A note on the telepresence microphones===
−
* {{num|2}} Username (in this example "root")
+
The noise cancelling microphones mounted in the robot's torso focus on audio from people directly in front of the robot.  This is by design, to reduce background noise and dialog from people who are not talking to the robot.
−
* {{num|3}} Robot serial number (in this example "rt-0096")
 
−
* {{num|4}} Open / Close [[#Right Side Panel: Guise (Projected Face robots only) and Eye Selector|right side panel]]: Guise (Projected Face robots only) and Eye Selector
 
−
* {{num|5}} View from robot's head camera
 
−
* {{num|6}}, {{num|7}}, {{num|8}}, {{num|9}}, {{num|10}} Mood modifiers "Happy", "Sleep", "Normal", "Sad", "Angry"
 
−
* {{num|11}}, {{num|12}}, {{num|13}}, {{num|14}} Gestures "Point Left", "Welcome", "Relax", "Point Right"
 
−
* {{num|15}} Open [[#TTS Panel|TTS Panel]] - you can use any installed [[Text-to-Speech]] voices as well
 
−
* {{num|16}} Operator view
 
−
* {{num|17}} Android back button, use to return to previous screen in Android OS
 
−
* {{num|18}} Android home button, use to return to tablet's home screen
 
  
−
===Left Side Panel: Volume Controls, and Settings switches===
+
If you have trouble hearing someone, ask them to stand in front of you, approx. 1m away and not to the sides, so you can hear them better.
−
[[File:1443-EA-Telepresence-left-side-panel.png|thumb|none|800px|link=|Left Side Panel: Volume Controls, and Settings switches (RoboThespian version)]]
 
  
−
* {{num|2}} (3 lines button) - Open / Close left side panel
+
===Logging Out===
−
* {{num|21}} Return to robot selection screen
+
* When finished with a telepresence session press the red up arrow in the left side panel to log out of the robot and return to the robot selection screen.
−
* {{num|22}} Logout of Telepresence
 
−
* {{num|23}} Full Screen - switches video from head camera to full screen or normal (green = full screen, red = normal)
 
−
* {{num|24}} Show Faces - switches overlay showing detected faces on or off (green = on, red = off) - depends on optional SHORE
 
−
* {{num|25}} Robot volume = volume of your voice coming out of the robot.
 
−
** Blue area indicates current volume.
 
−
** Touch on the line between blue and black area and drag to adjust.  Start low to avoid feedback
 
−
** {{num|26}} Robot volume mute - touch in the middle on the mic symbol to mute / unmute (green = normal, red = muted).  When muted your voice is no longer heard coming out of the robot.
 
−
* {{num|27}} Headset volume
 
−
** Touch on the line between blue and black area and drag to adjust.
 
−
** Usually needs to be high to hear. 
 
−
** Please also make sure the tablet volume is set to maximum for the best experience (see #Power_and_volume_controls)
 
−
* {{num|28}} Headset volume mute / unmute (green = normal, red = muted).
 
  
 +
===Closing the Left Side Panel===
 +
* Press the grey right arrow or click anywhere outside of the left side panel to close it.
  
−
===Right Side Panel: Guise (Projected Face robots only) and Eye Selector===
+
===Head Control===
−
[[File:1443-EA-Telepresence-right-side-panel.png|thumb|none|800px|link=|Right Side Panel: Eye Control (RoboThespian version)]]
+
There are three simple ways to look around using Telepresence<br>
 +
1. Click on screen where you want the robot to look<br>
 +
2. The classic gamer's keyboard controls W, A, S, D also make the head look around<br>
 +
W - up, A - left, S - down, D - right:<br>
 +
[[File:Untitled-8.1.jpg|thumb|none|1024px|link=|Click on screen to control head & classic gamer keyboard ]]
  
−
* {{num|4}} (3 lines button) Open / Close right side panel
 
−
* {{num|5}} Eye selector - swipe left or right to view other available eyes. Click on desired eye to activate
 
  
 +
3. Use the joy stick at the bottom left corner. Drag the centre circle in the direction you want the head to travel. The further you drag the stick, the faster the head will move :<br>
 +
[[File:Untitled-7.1.jpg|thumb|none|1024px|link=|Joystick head movement]]
  
−
===TTS Panel===
+
===Accessing Content===
−
[[File:1443-EA-Telepresence-TTS-panel.png|thumb|none|800px|link=|TTS Panel]]
 
  
−
* {{num|1}} Click to open drop down menu and change language (from acapela [[Text-to-Speech]] voices installed on robot)
+
* Content can be accessed and triggered by clicking the wheel menu:
−
* {{num|2}} Click to open drop down menu and change voice (from acapela Text-to-Speech voices installed on robot)
+
[[File:Untitled-8.9.jpg|thumb|none|1024px|link=|click the wheel menu to access content]]
−
* {{num|3}} Type in the text you want the robot to speak using [[Text-to-Speech]]
 
−
* {{num|4}} Cancel button returns to the main Telepresence interface
 
−
* {{num|5}} Press Speak to make the robot speak your text
 
  
−
More voices are available if required, please [mailto:info@engineeredarts.co.uk contact Engineered Arts]
 
  
 +
* Content is arranged in folders on each segment of the wheel, identified with icons:
 +
[[File:Untitled-9.1.jpg|thumb|none|1024px|link=|content folders]]
  
−
==Troubleshooting==
 
−
===I can not find my username and password===
 
−
This is usually in your "Your robot is on its way" email from Engineered Arts.
 
  
−
Please try your wiki login (for this wiki) or Virtual Robot login - where practical the same login is used for all systems.
+
====Help====
 +
* Press (H) on your keyboard to show / hide text overlays and keyboard shortcuts on the buttons:
 +
[[File:Untitled-10.1.jpg|thumb|none|1024px|link=|Overlay shortcut]]
  
−
Note as of May 2016 Engineered Arts is working on a single sign in system for all robot websites and resources.
 
  
−
If you can not find your username/password please [mailto:info@engineeredarts.co.uk contact Engineered Arts]
+
===Accessing Content - continued===
 +
1. Songs:
 +
* Classic RoboThespian songs as well as some specially created for Tinman:
 +
[[File:Untitled-11.jpg|thumb|none|1024px|link=|Songs]]
  
−
===Tablet does not turn on===
 
−
Is the tablet charged?<br>
 
−
It may have lost charge during shipping / storage.  Charge the tablet
 
  
−
Have you held the power button down, not just pressed briefly?<br>
+
2. Impressions
−
Hold the power button for a couple of seconds to start up the tablet.
+
* Classic RoboThespian Impressions as well as some especially created for Tinman:
 +
[[File:Untitled-12.jpg|thumb|none|1024px|link=|Impressions]]
  
−
===I can't see what the robot sees - the background is black===
 
  
−
[[File:1443-EA-Telepresence-troubleshooting-no-video-from-robot.png|thumb|none|800px|link=|No video from robot]]
+
3. Faces
 +
* Happy, Angry, Sad and love are among the faces RoboThespian can use in this menu:
 +
[[File:Untitled-14.jpg|thumb|none|1024px|link=|Faces]]
  
−
==RoboThespian General Information for Telepresence Operator==
 
−
''The section contains useful general information to answer frequently asked questions. It covers basics about RoboThespian's History, Installations, Operations and Telepresance capabilities.
 
  
−
It is intended to guide a Telepresance operator at expos and public appearances. Feel free to adapt the responses. And remember, humour always helps!''  
+
4. Gestures
 +
* Waves, high five and shake hands as well as 'Rest Pose':
 +
[[File:Untitled-15.jpg|thumb|none|1024px|link=|Gestures]]
  
−
It can be fun to make your voice more robotic!
 
  
−
Information as at 21 June 2017
+
5. Loops
 +
* Loops are used for giving presentations or talks, Talking loop, Listening loop. these sequences will continue until stopped:
 +
[[File:Untitled-16.jpg|thumb|none|1024px|link=|Loops]]
  
−
==="What are you? What is a RoboThespian?"===
 
−
* "RoboThespian is a life sized humanoid robot designed for human interaction in a public environment"
 
−
* "RoboThespian is a 'born' entertainer, designed to greet visitors in museums, science centres, exhibitions and interact with people"
 
−
* "This model is version RT4. It is a 4th generation model"
 
−
* "RT4 represents over 12 years of continuous development"
 
  
−
==="What can you do?"===
+
6. One-Liners
−
* "RoboThespian can be setup to deliver content in any language using pre-recorded audio or using a synthetic text-to-speech voices."
+
* New quick content created, especially for TinMan. Like the impressions but snappier:
−
* "RoboThespian can speak in 32 different languages in 76 different voice variations"
+
[[File:Untitled-17.jpg|thumb|none|1024px|link=|One Liners]]
−
* "RoboThespians movements are controlled by our own web based system 'Virtual Robot' this allows the operator to manipulate the robot to his physical restraints and per program performances and scenes"
 
−
* "RoboThespian is able to estimate people's age and gender as well as determine whether they are happy, sad, angry or surprised"
 
−
* "Other software can be integrated by Engineered Arts to extend functionality, for example to detect where people are, what gestures they are making, where they are looking and recognise more expressions."
 
  
−
==="Where do you live? Where can I see you?"===
+
===Playing a Sequence===
−
* "Currently over 100 of our robots can be found around the world, over 80 of which are RoboThespians"
+
*click the sequence you wish the robot to perform:
−
* "Recently RoboThespian was part of a stage show, Spillikin, from Pipeline Theatre which travelled around the UK doing over 70 shows in over 50 locations. The play was incredibly well received by critics and by audiences."
+
[[File:Untitled-18.1.jpg|thumb|none|1024px|link=|Selecting a sequence]]
−
* "Recent sales, installations and high profile appearances include:
 
−
** "The Museum of Science and Industry, Chicago as part of a long term touring installation"
 
−
** "The London Science Museum as a long term touring installation"
 
−
** "Global Robot Expo, Spain, appearing on Engineered Arts' stand and on the stage as a live speaker"
 
−
** "Dublin Tech Summit taking part in a live panel discussion on the main stage, as well as working as a greeter in the main entrance, welcoming over 10,000 visitors"
 
  
−
(RoboThespian in action at Dublin Tech Summit video here for your information - https://www.youtube.com/watch?v=PQSj4wrxNaI)
 
  
−
* "Other sales include:"
+
# This icon shows the current sequence being played, sequences can be paused by pressing this icon
−
** "Phaeno Science Centre, Wolfsburg, Germany"
+
# The blue progress bar and count down timer are used to show how much time until the sequence finishes
−
** "NASA's visitor complex at Kennedy Space Centre"
+
# The stop button stops all sequences and returns the robot to rest pose
−
** "Legends of Robot Land, South Korea, where 2 RoboThespians perform as part of a robotic theatre alongside other robots"
+
# The robots face provides a real-time preview of the robot's face
−
** "Copernicus Science Centre, Warsaw, Poland, where 3 RoboThespians perform together and move on a custom built stage by Engineered Arts"
 
−
** "National Science centres of Spain, Australia (Questacon), Thailand and Israel"
 
−
* "Recently the first robot has been sold to Argentina and will be shipping in a matter of weeks."
 
−
* "Other countries RT can be found in:
 
−
** Australia
 
−
** Canada
 
−
** United Arab Emirates
 
−
** China
 
−
** Taiwan
 
−
** France
 
−
** Germany
 
−
** Israel
 
−
** Norway
 
−
** Poland
 
−
** Russia
 
−
** Kingdom of Saudi Arabia
 
−
** South Korea
 
−
** Spain
 
−
** Turkey
 
−
** Thailand
 
−
** United Kingdom
 
−
** United States of America"
 
  
−
==="What is Telepresence? How are you talking to me?"===
+
===Selecting Favourite Sequences for use on quick menu===
−
* Cheeky answer, as though really there. "I'm using my mouth, silly"
+
* Favourite or commonly used sequences can be drag and dropped into quick access buttons at the bottom of the screen:
 +
[[File:Untitled-19.jpg|thumb|none|1024px|link=|Quick menu selection]]
  
−
===="No seriously, how are you doing this?"====
 
−
* "Telepresence allows a person to jump into the robot from anywhere in the world, hear what the robot hears, see what the robot see, talk through the robot – as though they were there themselves. Telepresence is Very useful, and has been used for:"
 
−
* "Presenting talks on stage in front of large crowds (including Q&A)"
 
−
* "Taking part in panel discussions (allowing experts to have a remote presence and take part in debates)"
 
−
* "Telepresence conferences to or from remote places allowing a more human element to conference calls"
 
−
* "Remote operation of robots at trade shows, exhibitions and museums for entertainment or information"
 
  
−
==="How much do you cost?"===
+
# Select favourites or frequently used performances
−
Cheekily (set the eye graphics to dollar signs for more effect!)
+
# Click and drag, and as you begin to drag a circle will appear along the bottom of the screen
−
* "If you have to ask, you can't afford me!"
+
# Drag the sequence into the circle, and the sequence will now remain here until deleted
−
* "Too much for you!"
 
−
* "Free to those that can afford it, very expensive to those that can't"
 
  
−
(Info: "Free to those that can afford it, very expensive to those that can't" is a quote from British film, "Withnail and I" http://www.imdb.com/title/tt0094336/quotes)
+
* Sequences can be played and paused by clicking the icon:
 +
[[File:Untitled-22.jpg|thumb|none|1024px|link=|playing sequences on quick menu]]
 +
 
 +
 
 +
* The stop all function behaves as normal:
 +
[[File:Untitled-23.jpg|thumb|none|1024px|link=|stop all button]]
 +
 
 +
 
 +
Sequences can be deleted from this menu by dragging them into the bin (Sequences will still be available in the wheel menu)
 +
# Drag the sequence from the button
 +
# The stop button now becomes a bin. Dropping here will remove it from the favourites.
 +
[[File:Untitled-24.jpg|thumb|none|1024px|link=|deleting sequences from quick menu]]
 +
 
 +
 
 +
* Depending on the screen size up to 6 performances can exist on this menu at any time. Each can be triggered by number keys 1-6 respectively.
 +
[[File:Untitled-21.jpg|thumb|none|1024px|link=|multiple quick menu sequences]]
 +
 
 +
===Using Face Detection===
 +
Click the "hamburger" menu button (3 lines) on the right to open the right side panel
 +
*This panel allows you to toggle on/off face detection and auto wheel reset:
 +
[[File:Untitled-33.jpg|thumb|none|1024px|link=|opening menu]]
 +
 
 +
 
 +
# Face detection on/off
 +
# Auto wheel reset on/off
 +
[[File:Untitled-25.jpg|thumb|none|1024px|link=|enabling face detection & Auto wheel reset]]
 +
 
 +
 
 +
* Once face detection is active circles will appear over detected faces.
 +
*Blue Dotted Circle = Face Detected ; Yellow Dashed Circle = Looking at Face; Green Solid Circle: Face Manually Selected
 +
* Using the hot key (H) Gender and Age will appear next to the faces
 +
[[File:Untitled-26.jpg|thumb|none|1024px|link=|Face detection active]]
 +
 
 +
 
 +
* Click on a person's face on the screen to track that person automatically with robot's eyes and head - the circle around their head will turn green to show they are being tracked
 +
** Please note that quick head movements may result in tracking being lost
 +
** Clicking on the screen elsewhere or using W,A,S,D will override this
 +
[[File:Untitled-27.jpg|thumb|none|1024px|link=|Face detection active]]
 +
 
 +
===Changing Eye Graphics===
 +
 
 +
* Change RoboThespian's eye graphics by clicking on the dynamic face in the top left corner
 +
[[File:Untitled-28.jpg|thumb|none|1024px|link=|Face detection active]]
 +
 
 +
 
 +
* The eye graphic menu will open across the page
 +
* Select chosen eye graphic by clicking on the robots face
 +
[[File:Untitled-29.jpg|thumb|none|1024px|link=|Face detection active]]
 +
 
 +
 
 +
* Current eye graphic will show on dynamic robot face
 +
** Note: eye graphics will stay this way until changed or a sequence is played
 +
[[File:Untitled-30.jpg|thumb|none|1024px|link=|Face detection active]]
 +
 
 +
==Adding new loops==
 +
# In [[Virtual Robot]] make sure the animation starts and ends in the same position
 +
# Save it
 +
# Then in [[Virtual Robot Content Organizer]], open the properties panel (1) on the left of the screen, set Loop property (2) to "True".
 +
# Drag the loop sequence e.g. (3) to the folder of your choice within the telepresence_ui/wheel folders (4), best to use loops
 +
# Press sync (5)
 +
# Note, only the first 6 items (from top to bottom) appear in each part of the wheel - the interface gets too full otherwise
 +
 
 +
[[File:VR Organizer - loops.png|thumb|none|1024px|link=|VR Organizer - loops]]
 +
 
 +
=Automatic kiosk disabling=
 +
If your RoboThespian is supplied with a [[Touchscreen|touchscreen kiosk]] then the kiosk will automatically be disabled during touchscreen sessions and show the following image.
 +
 
 +
<div><ul>
 +
<li style="display: inline-block;">[[File:kiosk-720px.png|thumb|200px|link=|RoboThespian Touchscreen Kiosk]]</li>
 +
<li style="display: inline-block;">[[File:ts_cover.png|thumb|400px|image on kiosk when disabled]]</li>
 +
</ul></div>
 +
 
 +
=RoboThespian FAQs for Telepresence operators=
 +
Useful information for operators to answer frequently asked questions about RoboThespian's History, Installations, Operations and Telepresence capabilities.
 +
 
 +
See [[Telepresence - RoboThespian FAQ]]
 +
 
 +
=Troubleshooting=
 +
If you have issues with telepresence, please see [[Telepresence Troubleshooting]]
 +
 
 +
=Optional XLR output and inputs=
 +
If you have opted for Telepresence with optional XLR output and input then your RoboThespian will be fitted with an XLR breakout box which has 1 input XLR connection and 2 output XLR connections. This option is useful for venues and events where clean audio is required.
 +
 
 +
[[File:XLR in out out.jpg|thumb|left|400px|XLR breakout box with each connector labelled]]
 +
 
 +
 
 +
'''AUDIO OUT''' is balanced line level audio out of the robot, there are 2 outputs that can go to a mixing desk or to external amplifier / PA system with speakers.
 +
 
 +
'''AUDIO IN''' is balanced line level audio into the robot, there is 1 input for an external microphone, this is then sent via the TinMan system to the Telepresence operator over the internet.
 +
 
 +
The '''AUDIO IN''' can be used instead of the torso mounted microphones. An example application of this is a panel discussion with multiple people in the discussion having microphones.  The microphones feed into a mixing desk, and an output from the mixing desk can be sent to the robot via AUDIO IN connection. This allows the TinMan operator to easily and clearly hear all the panel members even if they are not directly in front of the robot.<div style="clear:both;"></div>
 +
 
 +
==If using XLR input, select EXTERNAL on NUC breakout==
 +
Check the switch positions for audio
 +
* INTERNAL - INPUT - EXTERNAL: selects robot's internal microphones, or an external microphone from XLR line in (line level)
 +
* EARTHLIFT - disconnects earth from line in at robot end, experiment with this on/off if experiencing audio noise with external microphone
 +
 
 +
[[File:NUC breakout with audio default switch positions and labels.jpg|600px|thumb|none|NUC breakout with audio default switch positions]]
 +
 
 +
 
 +
==Typical audio setup using XLR connections and TinMan Telepresence==
 +
 +
[[File:TinMan XLR Audio Setup.jpg|thumb|none|800px|TinMan XLR Audio Setup]]

Latest revision as of 07:34, 14 September 2022

Telepresence

Overview

TinMan Telepresence is a feature that allows an operator to use a PC with headset and microphone to control Engineered Arts' robots like RoboThespian or Mesmer and speak to an audience via the robot.

This allows for two way conversation with an audience stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.

A range of gestures, moods, and for Projected Face robots - different Guises (faces), can be triggered with a button press.

The operator can see what the robot sees and can select a specific person to talk to. Robot lipsyncs to your voice and will maintain eye contact with that person and move its head to keep them in view.

An inset view shows the robot's face in real time - you can see exactly the current expression, guise (for SociBot), eye type and where the robot is looking.

The operator can be located remotely anywhere in the world where there is an internet connection.

Robot RoboThespian shown.

Telepresence Overview

Hardware

  • Recommend touchscreen PC with good quality microphone headset
  • Microphone headset - recommend Sennheiser GSP 350.
    • The closed cups block out external noise
    • It has excellent noise cancellation so you don't hear your own voice.
    • Please note that there is a volume dial on the right ear cup (so if audio sounds quiet - please also check the dial)

TinMan Diagram.png

Touchscreen PC supplied by Engineered Arts

If you have opted for an touchscreen PC supplied by Engineered Arts please see Telepresence - touchscreen PC

Quickstart Instructions

Logging in to TinMan telepresence system

Login with your username and password to https://telepresence.engineeredarts.co.uk

You can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot. This will prevent audio feedback. Then, click on your robot to control it.

Telepresence Website


Once Logged in...

Select Video Stream Aspect Ratio

Click the "hamburger" menu button (3 lines) on the left to open the left side panel:

Left side panel button


Using the left side panel it is possible to select your preferred video aspect ratio:

Original size:

Video Stream Format, Original Size


Contain view - Recommended - shows all of the robot's field of view:

Video Stream Format, Contain (recommended)


Cover view - zooms to fill screen - you might lose some of what the robot can see:

Video Stream Format, Cover

Audio Controls

The left side menu also contains the audio controls

  • Tap the microphone symbol under the human face to toggle mute on or off. This will mute the operator's microphone
  • When muted a red box will appear around the screen - audience will now be unable to hear the operator's voice, however the operator will be able to hear the audience:
User mute


  • Tap the microphone symbol near the robot face to toggle robot's microphone on or off. When robot's microphone is off the operator will not hear the audience. However the audience may still hear the operator!
  • The slider controls the gain (sensitivity) of the robots microphone.
  • Use your PC / laptop audio controls to set headphones to a comfortable volume
  • If using the Sennheiser GSP 350 headset please note that there is a volume dial on the right ear cup (so if all audio sounds quiet please check the volume dial)
Robot pick-up mute and volume slider


  • Tap the speaker symbol near the robot face to toggle robot speaker on or off
  • The slider controls the volume of the robot's torso speaker
Robot speaker mute and volume slider

A note on the telepresence microphones

The noise cancelling microphones mounted in the robot's torso focus on audio from people directly in front of the robot. This is by design, to reduce background noise and dialog from people who are not talking to the robot.

If you have trouble hearing someone, ask them to stand in front of you, approx. 1m away and not to the sides, so you can hear them better.

Logging Out

  • When finished with a telepresence session press the red up arrow in the left side panel to log out of the robot and return to the robot selection screen.

Closing the Left Side Panel

  • Press the grey right arrow or click anywhere outside of the left side panel to close it.

Head Control

There are three simple ways to look around using Telepresence
1. Click on screen where you want the robot to look
2. The classic gamer's keyboard controls W, A, S, D also make the head look around
W - up, A - left, S - down, D - right:

Click on screen to control head & classic gamer keyboard


3. Use the joy stick at the bottom left corner. Drag the centre circle in the direction you want the head to travel. The further you drag the stick, the faster the head will move :

Joystick head movement

Accessing Content

  • Content can be accessed and triggered by clicking the wheel menu:
click the wheel menu to access content


  • Content is arranged in folders on each segment of the wheel, identified with icons:
content folders


Help

  • Press (H) on your keyboard to show / hide text overlays and keyboard shortcuts on the buttons:
Overlay shortcut


Accessing Content - continued

1. Songs:

  • Classic RoboThespian songs as well as some specially created for Tinman:
Songs


2. Impressions

  • Classic RoboThespian Impressions as well as some especially created for Tinman:
Impressions


3. Faces

  • Happy, Angry, Sad and love are among the faces RoboThespian can use in this menu:
Faces


4. Gestures

  • Waves, high five and shake hands as well as 'Rest Pose':
Gestures


5. Loops

  • Loops are used for giving presentations or talks, Talking loop, Listening loop. these sequences will continue until stopped:
Loops


6. One-Liners

  • New quick content created, especially for TinMan. Like the impressions but snappier:
One Liners

Playing a Sequence

  • click the sequence you wish the robot to perform:
Selecting a sequence


  1. This icon shows the current sequence being played, sequences can be paused by pressing this icon
  2. The blue progress bar and count down timer are used to show how much time until the sequence finishes
  3. The stop button stops all sequences and returns the robot to rest pose
  4. The robots face provides a real-time preview of the robot's face

Selecting Favourite Sequences for use on quick menu

  • Favourite or commonly used sequences can be drag and dropped into quick access buttons at the bottom of the screen:
Quick menu selection


  1. Select favourites or frequently used performances
  2. Click and drag, and as you begin to drag a circle will appear along the bottom of the screen
  3. Drag the sequence into the circle, and the sequence will now remain here until deleted
  • Sequences can be played and paused by clicking the icon:
playing sequences on quick menu


  • The stop all function behaves as normal:
stop all button


Sequences can be deleted from this menu by dragging them into the bin (Sequences will still be available in the wheel menu)

  1. Drag the sequence from the button
  2. The stop button now becomes a bin. Dropping here will remove it from the favourites.
deleting sequences from quick menu


  • Depending on the screen size up to 6 performances can exist on this menu at any time. Each can be triggered by number keys 1-6 respectively.
multiple quick menu sequences

Using Face Detection

Click the "hamburger" menu button (3 lines) on the right to open the right side panel

  • This panel allows you to toggle on/off face detection and auto wheel reset:
opening menu


  1. Face detection on/off
  2. Auto wheel reset on/off
enabling face detection & Auto wheel reset


  • Once face detection is active circles will appear over detected faces.
  • Blue Dotted Circle = Face Detected ; Yellow Dashed Circle = Looking at Face; Green Solid Circle: Face Manually Selected
  • Using the hot key (H) Gender and Age will appear next to the faces
Face detection active


  • Click on a person's face on the screen to track that person automatically with robot's eyes and head - the circle around their head will turn green to show they are being tracked
    • Please note that quick head movements may result in tracking being lost
    • Clicking on the screen elsewhere or using W,A,S,D will override this
Face detection active

Changing Eye Graphics

  • Change RoboThespian's eye graphics by clicking on the dynamic face in the top left corner
Face detection active


  • The eye graphic menu will open across the page
  • Select chosen eye graphic by clicking on the robots face
Face detection active


  • Current eye graphic will show on dynamic robot face
    • Note: eye graphics will stay this way until changed or a sequence is played
Face detection active

Adding new loops

  1. In Virtual Robot make sure the animation starts and ends in the same position
  2. Save it
  3. Then in Virtual Robot Content Organizer, open the properties panel (1) on the left of the screen, set Loop property (2) to "True".
  4. Drag the loop sequence e.g. (3) to the folder of your choice within the telepresence_ui/wheel folders (4), best to use loops
  5. Press sync (5)
  6. Note, only the first 6 items (from top to bottom) appear in each part of the wheel - the interface gets too full otherwise
VR Organizer - loops

Automatic kiosk disabling

If your RoboThespian is supplied with a touchscreen kiosk then the kiosk will automatically be disabled during touchscreen sessions and show the following image.

  • RoboThespian Touchscreen Kiosk
  • image on kiosk when disabled

RoboThespian FAQs for Telepresence operators

Useful information for operators to answer frequently asked questions about RoboThespian's History, Installations, Operations and Telepresence capabilities.

See Telepresence - RoboThespian FAQ

Troubleshooting

If you have issues with telepresence, please see Telepresence Troubleshooting

Optional XLR output and inputs

If you have opted for Telepresence with optional XLR output and input then your RoboThespian will be fitted with an XLR breakout box which has 1 input XLR connection and 2 output XLR connections. This option is useful for venues and events where clean audio is required.

XLR breakout box with each connector labelled


AUDIO OUT is balanced line level audio out of the robot, there are 2 outputs that can go to a mixing desk or to external amplifier / PA system with speakers.

AUDIO IN is balanced line level audio into the robot, there is 1 input for an external microphone, this is then sent via the TinMan system to the Telepresence operator over the internet.

The AUDIO IN can be used instead of the torso mounted microphones. An example application of this is a panel discussion with multiple people in the discussion having microphones. The microphones feed into a mixing desk, and an output from the mixing desk can be sent to the robot via AUDIO IN connection. This allows the TinMan operator to easily and clearly hear all the panel members even if they are not directly in front of the robot.

If using XLR input, select EXTERNAL on NUC breakout

Check the switch positions for audio

  • INTERNAL - INPUT - EXTERNAL: selects robot's internal microphones, or an external microphone from XLR line in (line level)
  • EARTHLIFT - disconnects earth from line in at robot end, experiment with this on/off if experiencing audio noise with external microphone
NUC breakout with audio default switch positions


Typical audio setup using XLR connections and TinMan Telepresence

TinMan XLR Audio Setup
Retrieved from ‘https://wiki.engineeredarts.co.uk/w/index.php?title=TinMan_Telepresence&oldid=11833’