Songscription offers "Shazam for sheet music," an AI-powered app

A forward-thinking startup named Songscriptionrecently debuted, showcasing AI technology capable of transforming song audio files into sheet music in mere minutes. This innovative product, operating on the basis of freemium model, targets both professional musicians and music enthusiasts.

"Our goal is to make the experience of playing music even more fun," expressed Andrew Carlins, brain behind Songscription and a Stanford MBA/MA in Education candidate. He envisages a future where even a high school band teacher nestled in rural Nebraska can effortlessly acquire tailored sheet music for their students' preferred tunes. This unique score would accommodate the specific instruments of the band, and adapt to the skill level of each student.

At inception, Songscription was designed to transcribe music for a variety of instruments, but it presents itself as being more refined for the piano. The team behind this innovative venture plan to expand its capabilities for additional instruments such as guitar tabs and even full band arrangements.

This product proves to be an efficient tool for musicians in the creative process. After recording a working song, they can upload it to generate the sheet music, bypassing the time-consuming task of transcribing by hand. Songscription has also included a feature that caters to those not well-acquainted with reading and writing sheet music - displaying a digital "piano roll" of the music being played out on a virtual piano.

Songscription has also incorporated a feature for automatically transcribing songs from YouTube links. Although they've safeguarded against copyright infringement by requiring users to confirm rights ownership before upload, the system can be easily manipulated to acquire sheet music of copyrighted songs for free.

"With respect to legalities, we're navigating in uncharted waters, but using our tech-enabled platform to give you a head start is really no different than playing a song by ear and recreating it on your home piano," stated Carlins.

The legalities of engaging with AI-enhanced creativity tools are currently a grey area. However, recent court rulings hint at a lean towards tech institutions rather than artists. Songscription isn't generating AI-based music, but instead is providing a fast-track tool for musicians to generate their own guitar tabs or sheet music.

"We see ourselves as an enhanced music notation software that quickens the transcription process for users given our editing capabilities," added Carlins.

Songscription's phenomenal AI model owes its foundation to a research article co-authored by co-founder Tim Beyer and researcher Angela Dai.

In its quest to gather the required training data for the model, Songscription has collaborated with certain willing musicians who were open to sharing or selling their piano performances and sheet music. They've also utilized public domain sheet music. But the lion's share of their training data turned out to be synthetic, as revealed by Carlins. In such cases, Songscription would rely on converting the data from sheet music to audio, further tweaking the files to emulate real-world conditions encompassing background noise and reverb.

Just seven months post establishment, Songscription has managed to secure pre-seed funding from Reach Capital and is set to join Stanford's StartX accelerator.

by rayyan