Found in Robotics News & Content, with a score of 22.84
July 29, 2022
…Calif.-based company introduced a structured domain randomization system within Omniverse Replicator that can help developers train and refine their models with synthetic data. Omniverse Replicator is a software development kit (SDK) built on the NVIDIA Omniverse platform that enables developers to build custom tools and workflows, said deep learning solutions architect Kshitiz Gupta and solutions architect Nyla Worker. “The NVIDIA Isaac Sim development team leveraged Omniverse Replicator SDK to build Isaac Replicator, a robotics-specific synthetic data-generation toolkit, exposed within the Isaac Sim app,” they wrote in a blog post. “As roboticists leverage AI to create better perception stacks for their…
Found in Robotics News & Content, with a score of 22.48
March 25, 2019
…be powered by NVIDIA GPUs. Image courtesy of NVIDIA. Omniverse for Collaborative Content Creation Forty-four minutes into the keynote, Haung discussed a common problem among filmmakers and 3D content creators. The modelers, the digital painters and the animators are all working on the same sequence, yet there's no digital environment that allows them to collaboratively work on the content at the same time. To fill the gap, NVIDIA wants to offer Omniverse. “[Omniverse] is an open collaboration tool. It works with all major 3D tools,” said Huang. For the purpose of the demo, Huang showed three individuals remotely collaborating in…
Found in Robotics News & Content, with a score of 22.31
January 08, 2024
…compute infrastructure in conjunction with its AI and NVIDIA Omniverse platforms to simulate and train AI models. The second computer in the model represents the robot's runtime environment, whether that's on the cloud or in a data center. LLMs help break down technical barriers Another element Talla mentioned as part of his presentation was the ability of LLMs to reduce techincal barriers with users. He described how typical users of a robot can use it's LLM through prompts and training and morph into a technical artist capable of creating complex robotics workcells or entire warehouse simulations. NVIDIA Picasso allows users…
Found in Robotics News & Content, with a score of 20.01
March 18, 2024
…in industrial infrastructure, saving significant time and cost. NVIDIA Omniverse, Metropolis, Isaac and cuOpt interact in AI gyms where developers can train AI agents to help robots and humans navigate unpredictable or complex events. An AI Gym for Industrial Digitalization In the demo, a digital twin of a 100,000-square-foot warehouse - built using the NVIDIA Omniverse platform for developing and connecting OpenUSD applications - operates as a simulation environment for dozens of digital workers and multiple autonomous mobile robots (AMRs), vision AI agents and sensors. Each AMR, running the NVIDIA Isaac Perceptor multi-sensor stack, processes visual information from six sensors,…
Found in Robotics News & Content, with a score of 19.53
June 17, 2022
…NVIDIA works to close 'reality gap' With its NVIDIA Omniverse applications, the Santa Clara, Calif.-based company has focused on ever more realistic simulation and digital twins to accelerate artificial intelligence for robots. “This follows our strategy for end-to-end robotics,” Andrews told Robotics 24/7. “We segment the intersection of robotics and AI into four phases of development: No. 1, train with Isaac Replicator and synthetic datasets. No. 2, simulate with digital twins, which are the focus of today's release.” “No. 3, build using Jetson Orin, Isaac ROS, SDKs [software development kits], and conversational AI, and No. 4, deploy and manage using…
Found in Robotics News & Content, with a score of 19.50
January 03, 2023
…for manufacturing and logistics robotics use cases.” The NVIDIA Omniverse application enables developers to import robot models and build realistic environments to validate both physical designs and software stacks for performance. Isaac Sim can also generate synthetic datasets to train the AI models for robotic perception. Developers can then use Isaac Sim's reinforcement learning API to train models in a robot's control stack, said NVIDIA during its special address at CES. Isaac Sim now supports simulations of people using obstacle avoidance and with common behaviors such as pushing carts. Source: NVIDIA Adding people to realistic simulations As more people work…
Found in Robotics News & Content, with a score of 18.74
October 20, 2023
…reinforcement learning research. Isaac Gym is built on NVIDIA Omniverse, a development platform for building 3D tools and applications based on the OpenUSD framework. Eureka itself is powered by the GPT-4 large language model. “Reinforcement learning has enabled impressive wins over the last decade, yet many challenges still exist, such as reward design, which remains a trial-and-error process,” said Anima Anandkumar, senior director of AI research at NVIDIA and an author of the Eureka paper. “Eureka is a first step toward developing new algorithms that integrate generative and reinforcement learning methods to solve hard tasks.” Eureka takes unmodified environment source…
Found in Robotics News & Content, with a score of 18.46
March 22, 2022
…application development and optimization such as NVIDIA Isaac on Omniverse, Clara for healthcare, Metropolis, and the TAO Toolkit. “AI model development is a time-consuming process,” Talla said. “NVIDIA's application frameworks include easy-to-use libraries that accelerate runtime applications.” These tools can reduce time and cost for production-quality AI deployments, allowing developers to access the largest, most complex models needed to solve robotics and edge AI challenges in 3D perception, natural language understanding, multisensor fusion, and more, NVIDIA said. NVIDIA touts ecosystem support, customer interest The company's embedded computing partners encompass a range of products and services, including cameras and other multimodal…
Found in Robotics News & Content, with a score of 18.33
May 29, 2023
…technology and industry are at a positive “tipping point.” Omniverse hosts simulations in real time “With generative AI, you could tell a robot what you want, and it could generate animations,” Huang claimed. He showed videos that took into account real-world physics and lighting and ran in simulation without any pre-programming. NVIDIA Omniverse connects computer-aided design (CAD) software, APIs, and frameworks for generative AI running on Microsoft's Azure cloud using real-time factory data and 5G networking, enabling collaboration among multiple users around the world. “Everything is ray-traced. We do everything in CAD; no art is necessary,” Huang said. “It's one…
Found in Robotics News & Content, with a score of 16.29
May 29, 2022
…robotics. We also recently upgraded to the new NVIDIA Omniverse-powered NVIDIA Isaac Sim, which has bought a raft of significant improvements to the BenchBot platform. Whether robotics is your hobby, academic pursuit, or job, BenchBot along with NVIDIA Isaac Sim capabilities enables you to jump into the wonderful world of robotics with only a few lines of Python. In this post, we share how we created BenchBot, what it enables, where we plan to take it in the future, and where you can take it in your own work. Our goal is to give you the tools to start working…
Found in Robotics News & Content, with a score of 16.00
March 14, 2023
…give some examples of how developers are using NVIDIA Omniverse and the Isaac robotics platform in creative ways? Andrews: The end-to-end Isaac robotics platform provides advanced AI and simulation software and accelerated computing capabilities—with corresponding hardware from the Jetson family—to the entire robotics ecosystem. More than 1,000 companies rely on one or many parts of NVIDIA Isaac, including companies that deploy physical robots developed and tested in the virtual world using Isaac Sim on Omniverse. Public examples of Isaac Sim users include: Amazon Robotics uses NVIDIA Omniverse Enterprise and Isaac Sim to simulate warehouse design, train robots with synthetic data…
Found in Robotics News & Content, with a score of 15.23
September 22, 2021
…Open Robotics’s Ignition Gazebo and NVIDIA Isaac Sim on Omniverse. Isaac Sim already supports ROS 1 and 2 out of the box and features an ecosystem of 3D content with its connection to popular applications such as Blender and Unreal Engine 4. With the two simulators interoperable, ROS developers can easily move their robots and environments between Ignition Gazebo and Isaac Sim to run large-scale simulations, said NVIDIA. They can also take advantage of each simulator’s advanced features such as high-fidelity dynamics, accurate sensor models, and photorealistic rendering to generate synthetic data for training and testing of AI models. “Developers…
