Teaching audio and MIDI editing in the MOOC

This is the fifth in a series of posts documenting the development of Play With Your Music, a music production MOOC jointly presented by P2PU, NYU and MIT. See also the first, second, third and fourth posts.

Soundation uses the same basic interface paradigm as other audio recording and editing programs like Pro Tools and Logic. Your song consists of a list of tracks, each of which can contain a particular sound. The tracks all play back at the same time, so you can use them to blend together sounds as you see fit. You can either record your own sounds, or use the loops included in Soundation, or both. The image below shows six tracks. The first two contain loops of audio; the other four contain MIDI, which I’ll explain later in the post.

Audio and MIDI tracks in Soundation

Continue reading

Teaching math with the Drum Loop

I’ve undergone some evolution in my thinking about the intended audience for my thesis app. My original idea was to aim it at the general public. But the general public is maybe not quite so obsessed with breakbeats as I am. Then I started working with Alex Ruthmann, and he got me thinking about the education market. There certainly a lot of kids in the schools with iPads, so that’s an attractive idea. But hip-hop and techno are a tough sell for traditionally-minded music teachers. I realized that I’d find a much more receptive audience in math teachers. I’ve been thinking about the relationship between music and math for a long time, and it would be cool to put some of those ideas into practice.

The design I’ve been using for the Drum Loop UI poses some problems for math usage. Since early on, I’ve had it so that the centers of the cells line up with the cardinal angles. However, if you’re going to measure angles and things, the grid lines really need to be on the cardinal angles instead. Here’s the math-friendly design:

math-friendly Funky Drummer lesson

Continue reading

Software design as research

Brown, A. (2007). Software Development as Music Education Research. International Journal of Education & the Arts. Volume 8, Number 6.

My thesis is supposed to include a quantitative research component. This had been causing me some anxiety. It’s educational and creative software. What exactly could I measure? I had this vague notion of testing people’s rhythmic ability before and after using the app. But how do you quantify rhythmic ability? Even if I had a meaningful numerical representation, how could I possibly measure a big enough sample size over a long enough time to get a statistically significant result? The development of my app is going okay, but I was really stressing about the experimental component.

The Drum Loop in Xcode

Then my advisor introduced me to Andrew Brown‘s notion of software development as research, or SoDaR. As Brown puts it, “SoDaR involves computers, but is about people.” Humans are complex, our interactions with computers are complex, the way we learn is complex. The only method of inquiry that can encompass all that complexity is qualitative, anthropological inquiry, involving a substantial amount of introspection on the part of the researcher.

Continue reading

Experience designers design experiences

Hassenzahl, M. (2010). Experience Design: Technology for All the Right Reasons. Morgan & Claypool.

For this week’s reading on experience design for music education, we moved up a level to think about experience design generally. A lot of design theory tends to boil down to “Design things better!” Marc Hassenzahl’s book falls into that trap a little, but he does have some useful specific ideas. His main thesis is that designers of technology aren’t just designing the technology itself. They’re designing the felt experience of using the technology (intentionally or not.) People care less about the technology itself and more about how they feel while using it.

Are You Experienced?

Continue reading

Drum Loop programming lesson concept images

Nearly getting scooped by Loopseque lit a fire under me to get some more concept images for my thesis app together. So here are some examples of the beat programming lessons that form the intellectual heart of my project. The general idea is that you’re given an existing drum pattern, a famous breakbeat or something more generic. Some of the beats are locked down, guaranteeing that anything you do will sound musical. Click each one to see it bigger.

Continue reading

Radial drum machine update

I’m planning to be done with my thesis by (gulp) December. My collaborator Chris and I got a basic prototype of the radial drum machine together over the summer using Max and Javascript. What we learned is that you don’t want to do an audio app in Max and Javascript, since it will be single-threaded and slower than molasses in January. Since then, we’ve been building the iOS version, which is going to include more features and be closer to the version I have in my head.

Continue reading

Designing music learning experiences with technology

This semester I’m working as a research assistant to Alex Ruthmann at NYU. The job includes helping him with a new joint music education and music technology  class, Designing Technologies & Experiences for Music Making, Learning and Engagement. Here’s the bibliography. The central class project is to create a music education technology experience — a lesson plan or classroom activity, a piece of software or hardware, or something outside those categories.

Everyone in the class has to maintain a blog documenting their design process. (Wouldn’t it be cool if every teacher of everything had their students blog about their class work?) My music education experience design is going to be my thesis, which I’m already blogging about. So instead I’ll use these posts for some public-facing note taking.

Continue reading

The Nirvana effect

I’m currently working on a book chapter about the use of video games in music education. While doing my research, I came across a paper by Kylie Peppler, Michael Downton, Eric Lindsay, and Kenneth Hay, “The Nirvana Effect: Tapping Video Games to Mediate Music Learning and Interest.” It’s a study of the effectiveness of Rock Band in teaching traditional music skills. The most interesting part of the paper comes in its enthusiastic endorsement of Rock Band’s notation system.

Rock Band 3 notation

The authors think that Rock Band and games like it do indeed have significant educational value, that there’s a “Nirvana effect” analogous to the so-called Mozart effect:

We argue that rhythmic videogames like Rock Band bear a good deal of resemblance to the ‘real thing’ and may even be more well-suited for encouraging novices to practice difficult passages, as well as learn musical material that is challenging to comprehend using more traditional means of instruction.

Continue reading

User Interface Design for Music Learning Software

Computers have revolutionized the composition, production and recording of music. However, they have not yet revolutionized music education. While a great deal of educational software exists, it mostly follows traditional teaching paradigms, offering ear training, flash cards and the like. Meanwhile, nearly all popular music is produced in part or in whole with software, yet electronic music producers typically have little to no formal training with their tools. Somewhere between the ad-hoc learning methods of pop and dance producers and traditional music pedagogy lies a rich untapped vein of potential.

This paper will explore the problem of how software can best be designed to help novice musicians access their own musical imagination with a minimum of frustration. I will examine a variety of design paradigms and case studies. I will hope to discover software interface designs that present music in a visually intuitive way, that are discoverable, and that promote flow.

Continue reading