---
publication_id: "OT-2026-000002181"
title: "Method and system for generating robotic instructions"
published_at: "2026-09-15T19:11:18.326403Z"
canonical_url: "https://opentechnical.org/p/OT-2026-000002181"
categories:
  - "robotics-automation/robot-architectures"
keywords:
  - "b25j9/1697"
  - "b25j9/1697"
  - "g06v10/82"
  - "b25j9/16"
  - "g06f40/151"
  - "g06f40/151"
---

# Method and system for generating robotic instructions

## Abstract

A computer-implemented method to generate robotic instructions is disclosed. The method may include receiving video data demonstrating one or more tasks and text data related to the one or more tasks. Further, the method may include encoding the video data and the text data, wherein the encoding is generated using at least one cross-attentional transformer. The method also includes receiving image data providing environmental data for at least one robotic task. Furthermore, the method may include encoding vision data corresponding to the image data. Consequently, the method may include generating robotic instructions based upon the video data, the text data and the vision data that was encoded.