Watch Your Ghost Teach a Robot How to Tag-Team
When Tesla failed to hit weekly production targets in the first quarter of 2018, chief executive Elon Musk blamed it on “excessive automation.” The robots were slowing things down and “underrated” humans could do better.
Musk resorted to pulling all-nighters and sleeping at the factory so that customer deliveries wouldn’t be further delayed.
Credit: Purdue University, CdesignLab
For those manufacturing jobs where humans have an edge, Purdue University engineers have introduced “GhostX:” An augmented reality platform that turns the user and robot into “ghosts.” The user can then plan out how to collaborate with the robot and work out kinks before actually performing a task.
“The dexterity of the human hand may never be replaced by the robot. But there are a lot of other tasks that are much more easily done by a robot, such as heavy lifting or precise manipulation,” said Yuanzhi Cao, a Ph.D. student in mechanical engineering at Purdue. “If we put their strengths together, productivity would increase.”
The technology solves a big engineering conundrum: For humans and robots to truly collaborate, they would have to know exactly what each other is doing.
“Factories currently prefer for humans and robots to work separately because they would need an extremely robust method to sync a human with a robot. That’s not the case for current technology,” Cao said.
With GhostX, whatever plan a user makes with the ghost form of the robot while wearing an augmented reality head mount is communicated to the real robot through a cloud connection – allowing both the user and robot to know what the other is doing as they perform a task.
The system also allows the user plan a task directly in time and space and without any programming knowledge. A YouTube video is available here.
“It’s totally codeless. The user programs the robot by demonstrating in an augmented reality environment how the two will work together,” said Karthik Ramani, the Donald W. Feddersen Professor of Mechanical Engineering.
First, the user acts out the human part of the task to be completed with a robot. The system then captures the human’s behavior and displays it to the user as an avatar ghost, representing the user’s presence in time and space.
Using the human ghost as a time-space reference, the user programs the robot via its own ghost to match up with the human’s role. The user and robot then perform the task as their ghosts did.
GhostX gives the user the option of either planning tasks to be completed at the same time or after each other. The system could also possibly work for planning the tasks of hundreds of robots at once, the researchers say.
The team will next explore the use of GhostX for training other humans.
A patent has been filed for this technology through the Purdue Research Foundation Office of Technology Commercialization. The work was funded by the National Science Foundation under grants FW-HTF 1839971, IIS (NRI) 1637961 and IIP (PFI:BIC) 1632154.
Contacts and sources:
Karthik Ramani, Yuanzhi Cao, Steve Tally, Kayla Wiles
Citation: GhostAR: A Time-space Editor for Embodied Authoring of Human-Robot Collaborative Task with Augmented Reality Yuanzhi Cao, Tianyi Wang, Xun Qian, Pawan S. Rao, Manav Wadhawan, Ke Huo, Karthik Ramani Purdue University DOI: 10.1145/3332165.3347902
Please Help Support BeforeitsNews by trying our Natural Health Products below!
Join our affiliate program and earn extra money by sharing with friends and family or by posting on your social media.
Order by Phone at 888-809-8385 or online at www.mitocopper.com
Get our Free Ebook, "Suppressed Health Secrets" with Natural Cures THEY don't want you to know!
APeX - Far superior to colloidal silver! Destroys Viruses, Bacteria, Pathogens with Oxygen plus Silver!
Supreme Fulvic - Nature's most important supplement! Vivid Dreams again!
Ultimate Curcumin - Natural pain relief, reduce inflammation and so much more.
pathogens and gives you more
energy. (See Blood Video)
Oxy Powder - Natural Colon Cleanser! Cleans out toxic buildup with oxygen!
Organic Hemp Extract (CBD) - Full Spectrum high CBD (3300mg) hemp extract eases stiff joints, relieves stress and more!
Nascent Iodine - Promotes detoxification, mental focus and thyroid health.
Smart Meter Cover - Reduces Smart Meter radiation by 96%! (See Video)
FINAL WARNING! Diseases are EXPLODING! Watch this Video about APeX and You'll THROW AWAY Your Colloidal Silver! APeX destroys Viruses, Bacteria and other Pathogens with the power of Oxygen PLUS Silver! Nobody else has a product like THIS! See why the inventor hasn't been sick in 16 years and why you'll never hear about it on the FAKE NEWS! Get some now and tell your friends about it too so we can reach more people!