OPENTECHNICAL PUBLICATION
OT-2026-000002718

Robotic task completion from natural language requests

Published: 2026-09-15T19:14:53.152994Z
Permanent URL: https://opentechnical.org/p/OT-2026-000002718
Categories: Robotics & Automation > Robot Architectures

------------------------------------------------------------------------

ABSTRACT

A computer-implemented method, apparatus and system is provided for robotic
task completion from natural language requests. The method may include:
receiving a natural language command, processing the natural language command
with a generative large language model to extract an intent and associated
context, creating a three-dimensional (3D) open-vocabulary semantic scene
graph of the environment, associating the scene graph with the intent and
associated context, creating, based at least in part on the scene graph, an
execution plan comprising a sequence of actions to complete the natural
language command, and generating executable code or tool calls corresponding
to one or more actions in the sequence of actions, and controlling one or more
robotic manipulators and/or actuators to perform one or more actions of the
sequence of actions based on the execution plan.

------------------------------------------------------------------------

OpenTechnical publication OT-2026-000002718
Published 2026-09-15T19:14:53.152994Z
https://opentechnical.org/p/OT-2026-000002718