Can ChatGPT create music? OpenAI might have the answer in the future – Here’s how

Can ChatGPT produce AI-powered music? OpenAI is reportedly developing a new artificial intelligence tool capable of generating music from text and audio prompts, according to a report by The Information. The technology could allow users to enhance existing videos with original soundtracks or add instrumental accompaniment, such as guitar, to pre-recorded vocals.

Details on the launch date remain unclear, and it is not known whether the service will be offered as a standalone product or integrated into existing OpenAI platforms, including ChatGPT and the video app Sora.

Collaboration with Juilliard Students

The Information also revealed that OpenAI is working with students from the Juilliard School to annotate musical scores. These annotations are expected to provide valuable training data for the model, potentially improving the AI’s ability to understand and generate music in a more nuanced, human-like manner.

A Continuation of OpenAI’s Audio Experiments

While OpenAI has experimented with generative music models in the past, these projects predate the launch of ChatGPT. In recent years, the company has primarily focused on audio models for text-to-speech and speech-to-text applications. OpenAI’s renewed interest in music generation signals an expansion of its creative AI efforts, joining other companies in the field such as Google and Suno, which have also developed generative music technologies.

Implications for Creators

If successfully developed, the tool could provide musicians, video editors, and content creators with an innovative way to produce music without traditional instruments or complex software. It may also open up new opportunities for AI-assisted composition in professional and educational settings.

Meanwhile, Bill Peebles, head of OpenAI’s video app Sora, has provided a comprehensive update on the platform’s forthcoming features, signalling a significant leap forward for the creative tool. In a post on X on Thursday, Peebles outlined a series of enhancements, ranging from new content creation options to improvements in social and performance aspects.

At the heart of the update are fresh creation tools, including a feature that allows users to generate character cameos. This will enable videos to include pets, favourite toys, or entirely AI-generated characters. Peebles suggested that the team anticipates a wave of “wildly inventive cameos” once the functionality becomes available. Additionally, Sora’s interface will be refreshed to highlight trending cameos in real time, making it easier for users to discover and engage with popular creations.