Skip to main content

Researchers Tap Robots for the Dirty, Dull and Dangerous

Postdoc Brian Lee, Professor Truong Nguyen, Professor Nikolay Atanasov, Ph.D. student Runfa Li, Ph.D student Nikola Raicevic
From left: Postdoc Brian Lee, Professor Truong Nguyen, Professor Nikolay Atanasov, Ph.D. student Runfa Li, Ph.D student Nikola Raicevic

Published Date

Article Content

Dirty, dull and dangerous: these are the types of jobs most fit for robotization. Yet, equipping robots to navigate dynamic environments and perform complex tasks is a tall order — even more so in the construction industry.

University of California San Diego Electrical and Computer Engineering Professors Truong Nguyen and Nikolay Atanasov and their team are trying to do just that.

The Jacobs School of Engineering researchers are nearly halfway through a three-year project to explore ways to integrate robotics into the construction industry and improve 3D reconstruction and mapping. Supported by KIAT (the Korea Institute for Advanced Technology), KETI (the Korea Electronics Technology Institute) and smart construction technology company ITOne, the grant funding adds up to $786,500 and runs through August 31, 2027.

“Understandably, most workers aren’t willing to put themselves into dangerous situations,” said Nguyen, a Qualcomm Institute (QI) Executive Committee member and QI affiliate through his position at the UC San Diego Center for Wireless Communications and head of the Video Processing Lab within the Department of Electrical and Computer Engineering. “The work that we’re doing now means that a single operator can remotely operate several robots that can perform those tasks in a more safe, efficient and convenient manner.”

“This is only one of the projects with KETI,” added Nguyen. KETI’s Intelligent Robotics Research Center focuses on robot intelligence, motion control and advanced sensing technology. “We’ve worked with KETI on many projects for over 10 years, and it’s been a very successful, fruitful partnership. ”

Atanasov, who directs the Existential Robotics Laboratory at UC San Diego, explained that their project intends to automate dangerous and dirty aspects of the construction industry. Robots can often assist with these kinds of tasks, like lifting heavy objects or welding, that can be difficult or perilous for human workers.

Reconstructing 3D environments

For a robot to effectively and safely complete a task, it must understand its environment and adapt its actions to fit a situation’s unique needs.

To change a light fixture on a high warehouse ceiling, for instance, the robot must synthesize information on its surroundings with potential actions that are safe to perform and can achieve certain goals. And, that assessment must somehow be accessible to the human watching or guiding it.

Projecting the real world into models via mapping is one way robots can analyze their environments.

“Mapping essentially turns an object the robot sees into a 3D reconstruction that can be viewed and manipulated on a computer screen,” said Runfa Li, an electrical and computer engineering Ph.D. student in Nguyen’s lab who leads the mapping efforts. Although this can be accomplished using various techniques, their method couples certain camera poses and orientations. “If we have images of an object and know which direction the camera is facing, we can accurately reconstruct the surface mesh.”

That’s step one. Step two requires the robot to actually execute its task.

Although the human directing the robot provides the high-level instructions — perhaps by clicking on the object a robot is supposed to engage with — it’s the robot’s job to translate those commands into action and to move itself to perform the job.

“It turns into a planning and control problem where the robot needs to take into account its understanding of the 3D environment, its safety and the human’s wants and then synthesize that into a plan,” said Atanasov. “It’s a major task; we’re interested in further developing synthesized robotics that streamline the process and make human-robot interactions smoother.”

Visualizing future use cases

Still, for robots, this type of visualization is a relatively new way of thinking.

Historically, robots would simulate the cause and effect of each of their potential actions to choose the best option for their task and to avoid collisions, explained postdoctoral researcher Brian Lee, who is part of Atanasov’s lab, which is affiliated with the UC San Diego Contextual Robotics Institute. Now, using visual mapping and 3D reconstruction, robots can identify everywhere they can safely move or engage with an object.

Coupled with human monitors who can identify potential dangers and correct a robot’s actions, that ability to move safely in an unstructured environment is exciting, Lee said, adding that it “opens up a greater range of possibilities and robotics applications.”

From a construction standpoint, this flexibility and awareness can lend itself to robots playing a bigger role in bringing projects from idea to reality — especially as modular design grows. This type of building slots together from prefabricated components like Lego blocks can produce a variety of projects faster and at a cheaper price point.

“I see robots playing a bigger role in this type of construction because many of those components will be made in advance,” Atanasov said. In his eyes, that will make it easier for robots to build and execute projects. “The humans can direct the operations and supervise the overall process. Or, we could have a scenario based on human-robot collaboration, where the robot does the brunt of the work and the human manages the more fine-grained manipulations.”

Robotic arm moving boxes
The robot developed by KETI, ITOne and UC San Diego. Credit: ITOne

More broadly, however, the mapping and processing technology the researchers are developing can also be used to make high-quality virtual reality more achievable. Currently, VR requires sophisticated algorithms and extensive filming. But, with highly detailed scanning and cameras at certain positions, Nguyen explained, a few strategic snapshots can quickly and accurately reconstruct a scene.

“Real estate agents want something like this that could let them scan a house in real-time and get 3D models of the rooms,” he said. “They could then show these reconstructions to potential buyers or renters who could explore an apartment’s layout virtually without ever having to visit.”

And, he’s confident that their technology can be that solution.

“We have the fastest, most accurate options for 3D reconstructions,” Nguyen said, “and we are very competitive in this area.”

What’s next

Another year and a half remain of the grant funding. What’s next for Nguyen, Atanasov and the rest of their robotics research crew?

Integration.

“We’re very happy with the results for the 3D construction, but we need to integrate that technology with robotic manipulators,” Lee said. “Now, we need to test it with a human operator and integrate our system with a compelling setup that can interface with a human.”

Although their technology will first be tested by funder ITOne in an apartment construction project using robotic arms, the team sees broader applications for the work beyond the construction industry.

“A lot of the research and algorithmic formulations are more general than this problem,” Atanasov said. “A robot being able to plan its motion and understand its surroundings can be applied to scenarios ranging from hospitals and warehouses to autonomous vehicles and agriculture. Even though they seem like completely different domains, the types of robotic processes are similar.”

A robot being able to plan its motion and understand its surroundings can be applied to scenarios ranging from hospitals and warehouses to autonomous vehicles and agriculture
Nikolay Atanasov

Topics covered:

Share This:

Category navigation with Social links