Difference between revisions of "TinMan Telepresence"

From Engineered Arts Wiki
Jump to navigation Jump to search
(RoboThespian General Information for Telepresence Operator)
Line 3: Line 3:
 
==Overview==
 
==Overview==
  
Telepresence is a feature that allows an operator to use an Android tablet with headset and microphone to control Engineered Arts' robots like [[RoboThespian]] or [[SociBot]] and speak to people via the robot.  
+
Telepresence is a feature that allows an operator to use a PC or certain Android tablets with headset and microphone to control Engineered Arts' robots like [[RoboThespian]] or [[SociBot]] and speak to people via the robot.  
  
 
This allows for two way conversation with people who are stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.
 
This allows for two way conversation with people who are stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.
  
A range of gestures, moods, and for [[Projected Face]] robots - different [[Guises|Guises (faces)]], can be triggered with a button press.  You can even customise what the buttons do.
+
A range of gestures, moods, and for [[Projected Face]] robots - different [[Guises|Guises (faces)]], can be triggered with a button press.
  
 
The operator can see what the robot sees and select the subject to talk to.  The robot will maintain eye contact with the subject and move its head to keep them in view.
 
The operator can see what the robot sees and select the subject to talk to.  The robot will maintain eye contact with the subject and move its head to keep them in view.
Line 23: Line 23:
  
 
==Tablet and Hardware==
 
==Tablet and Hardware==
Android tablet - currently [https://www.asus.com/uk/Tablets/Nexus_7_2013/ Google Nexus 7], supplied with microphone headset
+
Android tablet - currently [https://store.google.com/product/pixel_c Google Pixel C], supplied with microphone headset
  
[[File:800_telepresence_tablet_hardware.png|thumb|none|800px|link=|Telepresence Tablet and Hardware]]
+
==Quickstart Instructions in brief - screenshots to be added soon==
 
+
* Login with your username and password to https://telepresence.engineeredarts.co.uk
* {{num|1}} [https://www.asus.com/uk/Tablets/Nexus_7_2013/ Google Nexus 7]
+
** you can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot and then click on your robot to control it
* {{num|2}} 3.5mm headphone jack with adapter for microphone headset plugged in
+
* Clicking anywhere on the screen makes the robot look at that point
* {{num|3}} Microphone headset adaptor
+
* The classic gamers keyboard controls W, A, S, D also make the head look around
* {{num|4}} Microphone headset
+
** W - up, A - left, S - down, D - right
* {{num|5}} Microphone part of headset
+
* Click on a face on the screen to track that person automatically with robot's eyes and head
* {{num|6}} Micro USB connector with charger plugged in
+
** Clicking on the screen elsewhere or using W,A,S,D will override this
* {{num|7}} Tablet charger
+
* Click the folder icon on the right to open folders of content, the icon with an infinity symbol is for looped content like talking / listening.
 
+
* The other folders you should be able to guess, once a folder is open click on the performance you want - most are short, like one line film impressions.
 
+
* Stop button at bottom stops current content playing
===Power and volume controls===
+
* You can also drag your favourites from a folder down to the bottom of the screen for easy access.
[[File:800_telepresence_tablet_hardware_controls_v2.png|thumb|none|800px|link=|Telepresence Tablet Power and Volume Hardware Buttons]]
+
* Press H to show text overlays and keyboard shortcuts on the buttons
 
+
* Click the three lines on the top left to open the audio panel and access audio controls.  The up arrow returns you to the list of robots.
* {{num|8}} Power button - hold for a couple of seconds to power on the tablet
+
* We have had good results with this USB mic headset plugged into PC or laptop - Sennheiser GSP 350 Closed Back Gaming Headset - the closed cups block out external noise and it has excellent noise cancellation so you don't hear your own voice.
* {{num|9}} Volume rocker (up) - press the upper part of the volume rocker to increase tablet volume
 
* {{num|10}} Volume rocker (down) - press the lower part of the volume rocker to decrease tablet volume
 
 
 
Please also make sure the tablet volume {{num|9}} is set to maximum for the best experience with telepresence. ''Please take care if you use any other apps on the tablet, that may be much louder! You can reduce the volume for other apps.''
 
 
 
===Connecting the microphone headset===
 
[[File:800_telepresence_tablet_mic_headset_connections.png|thumb|none|800px|link=|Microphone Headset Adapter Connections]]
 
 
 
* {{num|21}} headset headphones jack plug (green), plugs into {{num|22}}
 
* {{num|22}} headphones socket on adaptor cable, [[File:headphones.png|24px]] symbol or similar on socket
 
* {{num|23}} headset microphone jack plug (pink), plugs into {{num|24}}
 
* {{num|24}} microphone socket, [[File:mic.png|12px]] symbol or similar on socket
 
 
 
 
 
==Starting Telepresence==
 
If you haven't already, power on your robot and power on the tablet.
 
 
 
From the home screen, press on the EA Telepresence icon {{num|1}}. 
 
 
 
This will take you to the login screen. Enter your username {{num|2}} and password {{num|3}} as supplied by Engineered Arts and then hit Login {{num|4}} .
 
 
 
[[File:1443-EA-Telepresence-icon.png|thumb|none|800px|link=|EA Telepresence Icon]]
 
[[File:1443-EA-Telepresence-login.png|thumb|none|800px|link=|EA Telepresence Login]]
 
 
 
 
 
Once logged in you will see the Telepresence Robots status page:
 
 
 
[[File:1443-EA-Telepresence-system-status.png|thumb|none|800px|link=|EA Telepresence System Status]]
 
 
 
* {{num|6}} System Status shows whether the Telepresence system is Online {{num|7}} or Offline
 
* {{num|8}} List of robots you can access with your Telepresence account. In this example [[RoboThespian]] with [[Serial_Number_Identification| Serial Number]] rt-0096.
 
* {{num|9}} Robot's status:
 
** Online - available for Telepresence
 
** Offline - Telepresence is not available (you may be out of wifi range of the robot's router, or Telepresence is not enabled on the robot)
 
** Busy - another user is logged into Telepresence
 
 
 
Click on your robot in the list to begin controlling it
 
 
 
 
 
==Telepresence Controls Overview==
 
===Main Controls===
 
[[File:1443-EA-Telepresence-main-controls.png|thumb|none|800px|link=|EA Telepresence Main Controls]]
 
 
 
* {{num|1}} Open / Close [[#Left Side Panel: Volume Controls, and Settings switches|left side panel]]: Volume Controls, and Settings switches
 
* {{num|2}} Username (in this example "root")
 
* {{num|3}} Robot serial number (in this example "rt-0096")
 
* {{num|4}} Open / Close [[#Right Side Panel: Guise (Projected Face robots only) and Eye Selector|right side panel]]: Guise (Projected Face robots only) and Eye Selector
 
* {{num|5}} View from robot's head camera
 
* {{num|6}}, {{num|7}}, {{num|8}}, {{num|9}}, {{num|10}} Mood modifiers "Happy", "Sleep", "Normal", "Sad", "Angry"
 
* {{num|11}}, {{num|12}}, {{num|13}}, {{num|14}} Gestures "Point Left", "Welcome", "Relax", "Point Right"
 
* {{num|15}} Open [[#TTS Panel|TTS Panel]] - you can use any installed [[Text-to-Speech]] voices as well
 
* {{num|16}} Operator view
 
* {{num|17}} Android back button, use to return to previous screen in Android OS
 
* {{num|18}} Android home button, use to return to tablet's home screen
 
 
 
===Left Side Panel: Volume Controls, and Settings switches===
 
[[File:1443-EA-Telepresence-left-side-panel.png|thumb|none|800px|link=|Left Side Panel: Volume Controls, and Settings switches (RoboThespian version)]]
 
 
 
* {{num|2}} (3 lines button) - Open / Close left side panel
 
* {{num|21}} Return to robot selection screen
 
* {{num|22}} Logout of Telepresence
 
* {{num|23}} Full Screen - switches video from head camera to full screen or normal (green = full screen, red = normal)
 
* {{num|24}} Show Faces - switches overlay showing detected faces on or off (green = on, red = off) - depends on optional SHORE
 
* {{num|25}} Robot volume = volume of your voice coming out of the robot.
 
** Blue area indicates current volume.
 
** Touch on the line between blue and black area and drag to adjust.  Start low to avoid feedback
 
** {{num|26}} Robot volume mute - touch in the middle on the mic symbol to mute / unmute (green = normal, red = muted).  When muted your voice is no longer heard coming out of the robot.
 
* {{num|27}} Headset volume
 
** Touch on the line between blue and black area and drag to adjust.
 
** Usually needs to be high to hear. 
 
** Please also make sure the tablet volume is set to maximum for the best experience (see #Power_and_volume_controls)
 
* {{num|28}} Headset volume mute / unmute (green = normal, red = muted).
 
 
 
 
 
===Right Side Panel: Guise (Projected Face robots only) and Eye Selector===
 
[[File:1443-EA-Telepresence-right-side-panel.png|thumb|none|800px|link=|Right Side Panel: Eye Control (RoboThespian version)]]
 
 
 
* {{num|4}} (3 lines button) Open / Close right side panel
 
* {{num|5}} Eye selector - swipe left or right to view other available eyes. Click on desired eye to activate
 
 
 
 
 
===TTS Panel===
 
[[File:1443-EA-Telepresence-TTS-panel.png|thumb|none|800px|link=|TTS Panel]]
 
 
 
* {{num|1}} Click to open drop down menu and change language (from acapela [[Text-to-Speech]] voices installed on robot)
 
* {{num|2}} Click to open drop down menu and change voice (from acapela Text-to-Speech voices installed on robot)
 
* {{num|3}} Type in the text you want the robot to speak using [[Text-to-Speech]]
 
* {{num|4}} Cancel button returns to the main Telepresence interface
 
* {{num|5}} Press Speak to make the robot speak your text
 
 
 
More voices are available if required, please [mailto:info@engineeredarts.co.uk contact Engineered Arts]
 
 
 
 
 
==Troubleshooting==
 
===I can not find my username and password===
 
This is usually in your "Your robot is on its way" email from Engineered Arts.
 
 
 
Please try your wiki login (for this wiki) or Virtual Robot login - where practical the same login is used for all systems.
 
 
 
Note as of May 2016 Engineered Arts is working on a single sign in system for all robot websites and resources.
 
 
 
If you can not find your username/password please [mailto:info@engineeredarts.co.uk contact Engineered Arts]
 
 
 
===Tablet does not turn on===
 
Is the tablet charged?<br>
 
It may have lost charge during shipping / storage.  Charge the tablet
 
 
 
Have you held the power button down, not just pressed briefly?<br>
 
Hold the power button for a couple of seconds to start up the tablet.
 
 
 
===I can't see what the robot sees - the background is black===
 
 
 
[[File:1443-EA-Telepresence-troubleshooting-no-video-from-robot.png|thumb|none|800px|link=|No video from robot]]
 
 
 
==RoboThespian General Information for Telepresence Operator==
 
''For useful general information to answer frequently asked questions, please see [[Telepresence - RoboThespian FAQ]]''
 

Revision as of 08:22, 28 June 2017

Telepresence

Overview

Telepresence is a feature that allows an operator to use a PC or certain Android tablets with headset and microphone to control Engineered Arts' robots like RoboThespian or SociBot and speak to people via the robot.

This allows for two way conversation with people who are stood in front of the robot and flexibility for the operator to respond in real time to any questions or comments with their own voice.

A range of gestures, moods, and for Projected Face robots - different Guises (faces), can be triggered with a button press.

The operator can see what the robot sees and select the subject to talk to. The robot will maintain eye contact with the subject and move its head to keep them in view.

Telepresence Overview
  1. Operator (can be out of sight of subject)
  2. Microphone headset
  3. Android tablet
  4. Robot RoboThespian shown
  5. Robot lipsyncs to your voice, says what you say, looks at subject
  6. Robot gestures with head and arm movements
  7. Subject speaking to robot


Tablet and Hardware

Android tablet - currently Google Pixel C, supplied with microphone headset

Quickstart Instructions in brief - screenshots to be added soon

  • Login with your username and password to https://telepresence.engineeredarts.co.uk
    • you can see which of your robots are online in green. Make sure the mic in your PC / laptop is muted or you are at least 5 - 10m from robot and then click on your robot to control it
  • Clicking anywhere on the screen makes the robot look at that point
  • The classic gamers keyboard controls W, A, S, D also make the head look around
    • W - up, A - left, S - down, D - right
  • Click on a face on the screen to track that person automatically with robot's eyes and head
    • Clicking on the screen elsewhere or using W,A,S,D will override this
  • Click the folder icon on the right to open folders of content, the icon with an infinity symbol is for looped content like talking / listening.
  • The other folders you should be able to guess, once a folder is open click on the performance you want - most are short, like one line film impressions.
  • Stop button at bottom stops current content playing
  • You can also drag your favourites from a folder down to the bottom of the screen for easy access.
  • Press H to show text overlays and keyboard shortcuts on the buttons
  • Click the three lines on the top left to open the audio panel and access audio controls. The up arrow returns you to the list of robots.
  • We have had good results with this USB mic headset plugged into PC or laptop - Sennheiser GSP 350 Closed Back Gaming Headset - the closed cups block out external noise and it has excellent noise cancellation so you don't hear your own voice.