404-GEN Launches Decentralized 3D Model Platform Integrated with Unity

Today, 404-GEN made headlines as the first decentralized platform for 3D model generation to integrate with Unity. This exciting development allows both developers and players to create models directly from the Bittensor mainnet right within the Unity environment. The company is focused on empowering the next generation of content creators, regardless of their professional status, to transform their creative visions into reality.

Ben James, the CEO of 404-GEN, a Switzerland-based startup, shared his enthusiasm in an interview with GamesBeat. "These people are not necessarily professionals or working in triple-A environments, but they still have very creative ideas. I want to bring those to life, and that's really what we're trying to do," he explained.

Now listed as a Verified Solution on the Unity Asset Store, this integration introduces a novel form of 3D representation using Gaussian Splatting. This technique brings decentralized content creation to Unity users, as James pointed out.

Gaussian Splatting is a fascinating computer graphics technique that scans an area and generates a point cloud to recreate the space in 3D. It achieves photorealistic 3D scenes by blending millions of tiny, translucent ellipsoids, or Gaussian splats. These splats, which carry data on position, color, size, and transparency, are often used to reconstruct digital twins of real places, resulting in stunningly realistic 3D models.

The technical team at Unity thoroughly evaluated the technology from 404-GEN and suggested several enhancements. A key recommendation was to redevelop certain AI dependencies to ensure the commercial viability of the models produced.

In response to these suggestions, 404-GEN introduced a "digital handshake" to streamline both the creative and legal processes for developers. This ensures that models generated by decentralized miners are immediately ready for commercial use. These improvements not only enhance the technical framework but also make the integration more accessible with a one-click process for developers of all skill levels.

Ben James emphasized the significance of this integration in a statement: "This integration is an important step for our ecosystem. It enables creators to work directly with decentralized 3D generation tools within the Unity editor, leveling the playing field for independent developers and designers. Our technology bridges traditional game development and decentralized networks, offering a practical solution that meets the commercial standards expected in the industry."

With a team of nine employees, 404-GEN is making strides in reducing technical barriers, encouraging experimentation with innovative 3D modeling techniques. This move reflects a broader trend of established Web2 companies collaborating with decentralized subnets on Bittensor, thereby expanding creative opportunities in game development and digital design.

Origins

The name 404-GEN draws inspiration from the familiar "404 error" encountered when accessing a non-existent webpage. Ben James, a crypto enthusiast, was captivated by the potential of blockchain technology. After delving into numerous white papers, he envisioned a way to incentivize various parties within a blockchain network to democratize content creation.

A couple of years ago, James founded 404-GEN with a focus on 3D imagery and AI. While there are other players in the market, James believes that 404-GEN stands out due to its decentralized approach. "When we generate 3D models, the code we write as a company is really code that's oriented around choosing the best 3D model for a particular prompt, whether it's an image or a text prompt, in real time, algorithmically, so, using things like visual language models or different types of multimodal models to do that," he said. "That means that there's no one size fits all solution here. There is no single foundation model, but, rather, what we rely on is the community of building on top of open-source models. These are state-of-the-art open-source models in order to find the best solutions depending on what a particular user is looking for."

Another unique aspect of 404-GEN is its use of Gaussian Splats for 3D representation. James sees tremendous potential in this approach, especially in AI and machine learning. "Within the gaming industry, it would allow things like lightweight 3D assets, so you can have more unique assets in a single scene," he explained. "You can convert them into meshes, which is the industry standard. But everything we generate is generated as a Gaussian splat."

The decentralized nature of 404-GEN's platform enables real-time, algorithmic generation of 3D models using visual language models and multimodal models. The platform relies on a community of builders contributing to open-source models to find the best solutions for users. When users submit prompts, they are sent to miners in the ecosystem who generate multiple competing models. The company then uses algorithms to select the best model for the user, while high-quality models that are not selected are saved in an open-source dataset. Miners are incentivized with tokens, with the highest rewards going to those producing the best results.

While 404-GEN is producing high-quality work, James believes that AI should enhance the intuition of designers and artists, making their roles even more creative.