Credit score: NVIDIA
PRESS RELEASE —NVIDIA at this time introduced main developments to Common Scene Description, or OpenUSD, that may develop adoption of the common 3D information interchange framework to robotics, industrial design and engineering, and speed up builders’ talents to construct extremely correct digital worlds for the following evolution of AI.
By way of new OpenUSD-based generative AI and NVIDIA-accelerated improvement frameworks constructed on the NVIDIA Omniverse™ platform, extra industries can now develop purposes for visualizing industrial design and engineering tasks, and for simulating environments to construct the following wave of bodily AI and robots.
The brand new choices embody NVIDIA NIM™ microservices for AI fashions that may generate OpenUSD language to reply consumer queries, generate OpenUSD Python code, apply supplies to 3D objects, and perceive 3D house and physics to assist speed up digital twin improvement. As well as, new USD connectors to robotics and industrial simulation information codecs and developer instruments let customers stream huge, totally NVIDIA RTX™ ray-traced datasets to Apple Imaginative and prescient Professional.
“The generative AI growth for heavy industries is right here,” stated Rev Lebaredian, vp of Omniverse and simulation know-how at NVIDIA. “Till not too long ago, digital worlds have been primarily utilized by artistic industries; now, with the enhancements and accessibility NVIDIA NIM microservices are bringing to OpenUSD, industries of all types can construct bodily based mostly digital worlds and digital twins to drive innovation whereas making ready for the following wave of AI: robotics.”
Generative AI Involves USD With NVIDIA NIMThe world’s first generative AI fashions for OpenUSD improvement, developed by NVIDIA, will probably be obtainable as NVIDIA NIM microservices. The fashions allow builders to include generative AI copilots and brokers into USD workflows, broadening the chances in 3D worlds and serving to pace the adoption of USD throughout a brand new vary of industrial sectors, like manufacturing, automotive and robotics.
The microservices obtainable in preview are:
USD Code NIM microservice — solutions common data OpenUSD questions and mechanically generates OpenUSD-Python code based mostly on textual content prompts that may then be inputted into an OpenUSD viewing app, corresponding to usdview from Pixar, or an NVIDIA Omniverse Package-based software to visualise the corresponding 3D information.
USD Search NIM microservice — allows builders to go looking via huge libraries of OpenUSD, 3D and picture information utilizing pure language or picture inputs.
USD Validate NIM microservice — checks the compatibility of uploaded information in opposition to OpenUSD launch variations and generates a completely RTX-rendered, path-traced picture, powered by NVIDIA Omniverse Cloud APIs, or software programming interfaces.
Newly introduced microservices that will probably be obtainable quickly are:
USD Structure NIM microservice — allows customers to assemble OpenUSD-based scenes from a sequence of textual content prompts based mostly on spatial intelligence.
USD SmartMaterial NIM microservice — predicts and applies a sensible materials to a computer-aided design object.
fVDB Mesh Technology NIM microservice — generates an OpenUSD-based mesh, rendered by Omniverse Cloud APIs, from point-cloud information.
fVDB Physics Tremendous-Res NIM microservice — performs AI tremendous decision on a body or sequence of frames to generate an OpenUSD-based, high-resolution physics simulation.
fVDB NeRF-XL NIM microservice — generates large-scale neural radiance fields in OpenUSD utilizing Omniverse Cloud APIs.
Foxconn, a worldwide manufacturing chief with greater than 170 factories worldwide, is already benefiting from NVIDIA’s computing platform, utilizing NIM microservices and Omniverse to create a digital twin of a manufacturing unit beneath improvement.
“Digital twins will assist us speed up the following wave of business manufacturing and autonomous machines,” stated Zhe Shi, chief digital officer and head of the Sensible Manufacturing platform at Foxconn. “NVIDIA Omniverse and the brand new NIM microservices will democratize the flexibility to develop digital twins and assist our groups construct bodily based mostly digital factories quicker than ever.”
WPP, a world chief in advertising and marketing and communications providers firm, is an early adopter of USD Search and USD Code NIM microservices, implementing them in its generative AI-enabled content material creation pipeline, constructed on NVIDIA Omniverse, for patrons corresponding to The Coca-Cola Firm.
“The great thing about the innovation is how appropriate it’s with the way in which we work, and that it leverages open requirements — accelerating not solely future work, however permitting us to proceed to construct on and prolong the usefulness of all our earlier investments in requirements like OpenUSD,” stated Stephan Pretorius, chief know-how officer at WPP. “Utilizing NVIDIA NIM microservices with NVIDIA Omniverse has made it attainable for us to launch revolutionary new manufacturing instruments with firms like The Coca-Cola Firm at unprecedented pace.”
USD Connectors Deliver Generative AI to Extra IndustriesA sequence of latest USD connectors for robotics information codecs and streaming to Apple Imaginative and prescient Professional opens the portals of OpenUSD interoperability and superior authoring to extra industries.
NVIDIA and Siemens, a worldwide chief in industrial automation and software program, are extending their collaboration to facilitate extra industrial workloads utilizing OpenUSD. Siemens will combine OpenUSD pipelines with its Simcenter portfolio of simulation applied sciences to assist evidence-based decision-making and collaboration amongst key stakeholders.
This integration allows high-fidelity, real-time, photorealistic visualization of complicated simulation information, offering deeper insights right into a product’s efficiency inside its real-world working atmosphere. The work will construct on Siemens’ efforts to include Omniverse into its Teamcenter Product Lifecycle Administration portfolio.
NVIDIA additionally launched a connector from Unified Robotics Description Format to OpenUSD, letting roboticists seamlessly deliver their robotic information throughout purposes, together with for design, simulation and reinforcement studying.
To additional advance OpenUSD ecosystem growth, NVIDIA introduced the OpenUSD Change software program improvement package, enabling builders to construct their very own strong OpenUSD information connectors.
New developer instruments and APIs to stream large-scale OpenUSD scenes from an software constructed on the Omniverse platform to Apple Imaginative and prescient Professional by way of the NVIDIA Graphics Supply Community at the moment are obtainable in early entry.
“OpenUSD is revolutionizing the way in which we create and work together with 3D content material,” stated Steve Could, chief know-how officer of Pixar and chairman of the Alliance for OpenUSD (AOUSD). “Now, with these new providers and APIs for OpenUSD constructed by NVIDIA, we anticipate to see accelerated progress and adoption of USD, paving the way in which for brand new customers and industries to extra simply interact with our ecosystem.”
OpenUSD Ecosystem Momentum
