Abstract
Embodiments of the present disclosure relate to defining tasks in scenes using delta information. In operation, some embodiments first receive or generate scene data. Some embodiments then generate delta information indicating one or more changes within the scene data. For example, responsive to user input, particular embodiments generate the delta information, such as a delta layer. Generating such delta information is useful in various applications such as robotics, simulation, graphics rendering, gaming, autonomous driving, or the like. For instance, with respect to robotics, some embodiments store data corresponding to the delta information as at least part of a task definition for a robotic task. Some embodiments then responsively cause or train one or more real-world robotic components represented by one or more virtual robotic components to perform a task in a real-world scene represented by a virtual scene based on the delta information and the task definition.