Stability AI Enhances Audio Model for Arm Chips

# ARM # audio # mcw

AI startup Stability AI has joined forces with chipmaker Arm to bring Stability's Stable Audio Open, an AI model capable of generating audio like sound effects, to mobile devices powered by Arm chips. While apps like Suno and Udio can generate audio, they typically depend on cloud processing, which means they're not usable offline. Plus, some audio generation models have been trained on copyrighted material, raising IP concerns. Stability, however, asserts that Stable Audio Open was trained solely on royalty-free audio and songs. At this week's Mobile World Congress in Barcelona, Stability will showcase Stable Audio Open running on Arm chips. This model can create sounds from text prompts, such as "Gentle ocean waves at sunset." Thanks to collaboration with Arm, Stability has optimized and "distilled" Stable Audio Open, boosting generation speeds by 30 times. On an Armv9 CPU, creating an 11-second audio sample now takes just about 8 seconds. Just to clarify, the optimized Stable Audio Open model isn't ready for download yet. But Stability's CEO, Prem Akkaraju, hinted in a statement that the company aims to integrate its models, including Stable Audio Open, into consumer apps and devices down the line. Akkaraju emphasized, "As more and more professional creatives and businesses adopt generative AI to power their production pipeline, it's crucial that our models and workflows are accessible everywhere for builders to build and creators to create. We're thrilled to partner with Arm for this very reason." Stability is also working with Arm to further refine and optimize Stable Audio Open for mobile use. Stability, the company behind the well-known image generation model Stable Diffusion, managed to secure new funding last year. Investors like Eric Schmidt and Napster founder Sean Parker stepped in to help steer the company back on track. Previously, Stability's co-founder and former CEO, Emad Mostaque, was said to have mismanaged the company to the brink of financial collapse, causing staff departures, a failed partnership with Canva, and investor unease about the company's future. In recent months, Stability has brought on a new CEO, welcomed Titanic director James Cameron to its board, and launched several new image generation models.

Related article

Comments (28)