Found in Robotics News & Content, with a score of 8.14
…is an open-source robot learning framework built on NVIDIA Omniverse, a platform for developing OpenUSD applications for industrial digitalization and physical AI simulation. Developers can use Isaac Lab to train robot policies at scale. This open-source unified robot learning framework can apply to any embodiment - including humanoids, quadrupeds, and cobots - to handle increasingly complex movements and interactions. Commercial robot makers, robotics application developers, and robotics research entities around the world are adopting Isaac Lab, including 1X, Agility Robotics, The AI Institute, Berkeley Humanoid, Boston Dynamics, Field AI, Fourier, Galbot, Mentee Robotics, Skild AI, Swiss-Mile, Unitree Robotics, and XPENG…
Found in Robotics News & Content, with a score of 36.54
…workflow. The workflow combines NVIDIA Metropolis vision AI, NVIDIA Omniverse physically based rendering and simulation and NVIDIA Isaac AI robot development and deployment. By using the workflow to build digital twins for real-time simulation of different factory layouts, manufacturers can optimize space, processes and efficiency without costly physical changes. The news came from NVIDIA founder and CEO Jensen Huang’s keynote demo at COMPUTEX 2024. Electronics manufacturers adopt NVIDIA technology to build robotic facilities Delta Electronics, Foxconn, Pegatron and Wistron are using the reference workflow to build, simulate and operate their robotics-enhanced facilities. In a COMPUTEX keynote demo, NVIDIA founder and…
Found in Robotics News & Content, with a score of 12.77
…changing that. Enlisting NVIDIA Isaac Sim on the NVIDIA Omniverse platform, Intrinsic generated synthetic data for vacuum grasping using computer-aided design models of sheet metal and suction grippers. This allowed Intrinsic to create a prototype for its customer Trumpf Machine Tools, a leading maker of industrial machine tools. The prototype uses Intrinsic Flowstate, a developer environment for AI-based robotics offerings, for visualizing processes, associated perception and motion planning. With a workflow that includes Isaac Manipulator, a user can generate grasp poses and CUDA-accelerated robot motions, which can first be evaluated in simulation with Isaac Sim - a cost-saving step -…
Found in Robotics News & Content, with a score of 6.48
…successor to Isaac Gym, Isaac Lab benefits from NVIDIA Omniverse technologies for physics-informed, photorealistic, perception-based reinforcement learning tasks. Isaac Lab is an open-source, performance-optimized app for robot learning built on the Isaac Sim platform. It incorporates reinforcement learning APIs and a developer-friendly tasking framework. Cloud-native robotics workflow scheduling with NVIDIA OSMO NVIDIA OSMO scales workloads across distributed environments. For robotics workloads with complex multi-stage and multi-container workflows, the platform provides a location-agnostic deployment option and dataset management and traceability features for deployed models. “Boston Dynamics employs a range of machine learning, reinforcement learning and AI technologies to power our robots,”…
Found in Robotics News & Content, with a score of 20.01
…in industrial infrastructure, saving significant time and cost. NVIDIA Omniverse, Metropolis, Isaac and cuOpt interact in AI gyms where developers can train AI agents to help robots and humans navigate unpredictable or complex events. An AI Gym for Industrial Digitalization In the demo, a digital twin of a 100,000-square-foot warehouse - built using the NVIDIA Omniverse platform for developing and connecting OpenUSD applications - operates as a simulation environment for dozens of digital workers and multiple autonomous mobile robots (AMRs), vision AI agents and sensors. Each AMR, running the NVIDIA Isaac Perceptor multi-sensor stack, processes visual information from six sensors,…
Found in Robotics News & Content, with a score of 23.33
…NVIDIA Isaac Sim, a robotics simulator developed on NVIDIA Omniverse, to build a simulated robotic programming environment for its aluminum hot forging production lines. This collaboration is set to enhance safety and efficiency in Toyota’s manufacturing processes. Typically, programming robotic systems for forging necessitates that the metal parts remain hot during programming, presenting significant safety challenges. With the integration of ForgeOS and NVIDIA Isaac Sim - an extensible application developed on the Omniverse platform for simulating, developing and testing robots - programming can now be accomplished in a simulated environment, eliminating the risks associated with hot parts. Safeguards in the…
Found in Robotics News & Content, with a score of 22.31
…compute infrastructure in conjunction with its AI and NVIDIA Omniverse platforms to simulate and train AI models. The second computer in the model represents the robot's runtime environment, whether that's on the cloud or in a data center. LLMs help break down technical barriers Another element Talla mentioned as part of his presentation was the ability of LLMs to reduce techincal barriers with users. He described how typical users of a robot can use it's LLM through prompts and training and morph into a technical artist capable of creating complex robotics workcells or entire warehouse simulations. NVIDIA Picasso allows users…
Found in Robotics News & Content, with a score of 11.38
…replicate reef conditions and investigate systems such as NVIDIA Omniverse, a platform for building and connecting 3D tools and applications. Creating a digital twin of Earth in Omniverse, NVIDIA is developing the world’s most powerful AI supercomputer for predicting climate change, called Earth-2. Scientists are developing Jetson-powered undersea research assistants. Credit: Austin Greene, Woods Hole Oceanographic Institution DeepSeeColor model helps underwater perception “Seeing underwater isn’t as clear as seeing on land,” noted Martin. “Over distance, water attenuates the visible spectrum of light from the sun underwater, muting some colors more than others. At the same time, particles in the water…
Found in Robotics News & Content, with a score of 18.74
…reinforcement learning research. Isaac Gym is built on NVIDIA Omniverse, a development platform for building 3D tools and applications based on the OpenUSD framework. Eureka itself is powered by the GPT-4 large language model. “Reinforcement learning has enabled impressive wins over the last decade, yet many challenges still exist, such as reward design, which remains a trial-and-error process,” said Anima Anandkumar, senior director of AI research at NVIDIA and an author of the Eureka paper. “Eureka is a first step toward developing new algorithms that integrate generative and reinforcement learning methods to solve hard tasks.” Eureka takes unmodified environment source…
Found in Robotics News & Content, with a score of 23.23
…on Jetson Nano” and “Develop, Customize and Publish in Omniverse With Extensions.” Once he learned the basics of robotics, he began experimenting with simulation in NVIDIA Omniverse, a platform for building and operating 3D tools and applications based on the OpenUSD framework. “Using Omniverse for simulation, I don’t need to invest heavily in prototyping models for my robots, because I can use synthetic data generation instead,” he said. “It’s the software of the future.” Personal inspiration for innovator With the help of AI, robots, tractors, baby strollers, and even skate parks are becoming autonomous, noted NVIDIA. With this latest NVIDIA…
Found in Robotics News & Content, with a score of 30.96
…Corp. today announced a major release of its NVIDIA Omniverse software that it said offers new foundation applications and services for developers to enhance and optimize their 3D pipelines with the OpenUSD framework and generative AI. Omniverse is a Universal Scene Description or OpenUSD-native platform for connecting, describing, and simulating across 3D tools and applications. NVIDIA said the update accelerates the creation of virtual worlds and advanced workflows for industrial digitalization. Cesium, Convai, Move AI, SideFX Houdini, and Wonder Dynamics are now connected to Omniverse via OpenUSD, said the Santa Clara, Calif.-based company in a release. Key highlights from the…
Found in Robotics News & Content, with a score of 32.80
…to integrate its lidar sensors with NVIDIA's DRIVE and Omniverse ecosystems. “By combining our expertise in lidar technology with NVIDIA's world-class simulation and software-development platforms, we can provide developers with invaluable insights and resources for unlocking the full potential of lidar in autonomous driving applications,” said Bob in den Bosch, senior vice president of global sales at Hesai Technology Co., in a release. Hesai said its products enable advanced driver-assistance systems (ADAS) and autonomous vehicle (AV) fleets. The Shanghai-based company's technology also empowers robotics applications such as last-mile delivery robots and logistics robots in restricted areas. Yole Group last month…