New software simplifies editing and creating AI-generated 3D models for practical use
A new tool called InstructMesh allows users to easily edit and fabricate AI-generated 3D models, addressing common design flaws. Developed by researchers from MIT, Google, and Northeastern University, it combines AI-driven design with user-friendly features to create functional household items and accessories.
InstructMesh is a design software that simplifies the process of creating and editing 3D models generated by AI.
The tool was developed by researchers at MIT's Computer Science and Artificial Intelligence Laboratory, Google, and Northeastern University, and is designed to help users refine 3D designs before printing.
It integrates Microsoft's TRELLIS system for generating 3D models from text and image prompts with the capabilities of GPT-4, a large language model.
InstructMesh has been used to create unique items, such as a mug with a dragon handle and a knee brace that resembles denim.
The software allows users, including novices, to identify and correct design flaws in generated models, achieving a success rate of around 90% in fixing issues.
Users have reported that InstructMesh is easy to use and enables them to express a wide range of design ideas with precision.
Future developments may include incorporating augmented reality features and physics simulations to enhance the design process.
The research team plans to present their findings at the ACM Symposium on User Interface Software and Technology in November.