OpenTechnical
This is a record of a document published elsewhere, first published by the United States Patent and Trademark Office, as US-2026048505-A1, on 19 February 2026. OpenTechnical did not first disclose it. The identifier, hashes and timestamps below record what this library served and when, not when the material became public. View the original.

OT-2026-000002718

Robotic task completion from natural language requests

Published
Permanent URL
Classification
Robotics & Automation › Robot Architectures
Inventors
BADGER ANDREW R, HANDELMAN DAVID A, HOLMES EMMA A, PAUL WILLIAM A, RIVERA CORBAN G
Assignee
UNIV JOHNS HOPKINS
Original source
US-2026048505-A1, the United States Patent and Trademark Office, 19 February 2026
Document SHA-256
fdf38969cab61b2ecbb238a694432d6033d5385950bf851cb2ba71f133d445ef

Abstract

A computer-implemented method, apparatus and system is provided for robotic task completion from natural language requests. The method may include: receiving a natural language command, processing the natural language command with a generative large language model to extract an intent and associated context, creating a three-dimensional (3D) open-vocabulary semantic scene graph of the environment, associating the scene graph with the intent and associated context, creating, based at least in part on the scene graph, an execution plan comprising a sequence of actions to complete the natural language command, and generating executable code or tool calls corresponding to one or more actions in the sequence of actions, and controlling one or more robotic manipulators and/or actuators to perform one or more actions of the sequence of actions based on the execution plan.

Publication information

Citation

OpenTechnical Publication OT-2026-000002718, “Robotic task completion from natural language requests,” published September 15, 2026 at 19:14:53 UTC, https://opentechnical.org/p/OT-2026-000002718.

To cite specific content, add the paragraph or figure numbers.

Terms

This record reproduces a document published elsewhere and is provided for reference and study. Rights in the original remain with its owner. See the publication policy.