Modulation gives electronic sound its movement. It can make a static tone breathe, pull an effect into the foreground or slowly change the character of an entire passage. Most of that movement is programmed in advance. An LFO repeats a shape, an envelope follows a trigger and an automation curve moves through a series of fixed points. More complex systems can combine several sources, respond to incoming audio or introduce probability and randomness.
But what happens when modulation is not decided beforehand? What changes when a musician controls it while listening, choosing not only how far a parameter moves, but also when the movement begins, how long it lasts and whether it should return at all?
The question is not whether human control can produce curves that a modulation system cannot. Almost any movement can eventually be programmed. The more interesting question is what happens when that movement is shaped within the music rather than placed on top of it in advance. At that point, modulation is no longer only a property of the sound. It becomes part of the performance.
Music does not always move on the grid
Tempo-synchronised modulation is a natural part of electronic music. A filter that opens every two beats or a delay that shifts over four bars can strengthen the rhythm and give a track a clear internal motion. Repetition can create stability, expectation and tension. There is nothing inherently lifeless about a movement simply because it is regular.
The problem begins when every change is tied to the same clock. Musical time is more complicated than a sequence of equal divisions. A phrase may start on the beat, but its emotional weight can develop between beats. A sound may continue to change after the musical event that caused it has ended. A transition can feel complete halfway through a bar, or remain unresolved several seconds after the next section has begun.
Musicians respond to these moments almost without thinking. A singer may hold a note longer because the previous phrase created more tension than expected. A pianist may delay an arrival slightly, not because the tempo has changed, but because the music needs another moment before it settles. The beat remains present, yet the expression moves around it.
Live modulation can follow this less visible layer of time. A gesture can begin after the obvious accent, move slowly while the rhythm continues unchanged or stop before reaching its expected destination. It can respond to the decay of a sound rather than the start of a note. It can wait until the listener has become accustomed to a texture before disturbing it.
That timing is not random. It is shaped by attention.
A modulation curve does not contain its own meaning
A rising line in an automation lane tells you that a value increases. It does not tell you why the movement happens there, what preceded it or what the listener expects to happen next. The same curve can feel gentle, tense, disruptive or almost irrelevant depending on its place in the music.
This is why expressive modulation cannot be reduced to unusual shapes or small timing errors. Adding randomness may make a movement less predictable, but unpredictability is not the same as intention. A random process does not know when a sound has become fragile or when a passage is holding back. It cannot decide that a movement should arrive late because an earlier event still seems unfinished.
Expression comes from relationships. A slow change gains weight because something remained stable before it. A sudden reversal is noticed because the movement appeared to have a clear direction. A long pause matters because the listener expects the sound to continue developing. Without that context, the same actions are simply changes in value.
This also explains why a performed gesture may feel different from a carefully drawn curve, even when the final result looks similar. The drawn curve is designed with knowledge of its full shape. The performed gesture is created without that overview. Each part is influenced by the sound produced by the part before it.
A performer may begin a movement with a clear intention, then slow down after hearing how quickly the sound opens up. The gesture may stop earlier because the effect is stronger than expected, or continue longer because the surrounding music leaves more space. The result develops through listening. It is not just executed.
The importance of hesitation
Much of the emotion in a gesture is found in the parts where little appears to happen. A parameter may remain close to the same value for a moment before continuing. The hand may approach a point, hesitate and then move away again. These small changes in speed and direction are difficult to describe in technical terms, yet they strongly affect how the movement is perceived.
A smooth, uninterrupted transition often sounds inevitable. The listener quickly understands its direction and waits for it to finish. A movement that slows down near its destination creates a different kind of attention. It suggests that the arrival is uncertain, or that reaching it has consequences. The delay itself becomes part of the phrase.
The reverse can also happen. A slow movement may suddenly accelerate, making the earlier restraint feel deliberate. A sound can seem to break away from the control that held it back. The parameter values matter, but the emotional effect comes from the way the speed changes over time.
This resembles phrasing on an acoustic instrument. A note is never defined only by its pitch and volume. Its attack, development and release determine how it is understood. Electronic modulation has similar qualities. It can lean into a change, resist it, overshoot or withdraw. It can suggest confidence, hesitation, pressure or release without imitating any specific acoustic gesture.
These qualities are rarely captured by choosing a waveform. They come from the movement between positions.
Why automation feels different
Automation is one of the most precise tools available to a producer. It allows a change to be placed exactly where it is needed, repeated reliably and adjusted after the fact. It is often the right choice, especially when a mix contains many interdependent movements that must remain consistent.
But automation also changes how the producer approaches time. A curve is normally created from outside the performance. You can see the whole passage, compare one section with another and correct the movement until it fits. The process is closer to editing than playing.
That distance is useful, but it can encourage decisions based on appearance. Curves are aligned, smoothed and divided into sections. Points are placed on beats because the grid makes them easy to organise. Similar movements are copied because repetition keeps the arrangement clear. None of this is wrong, but it can gradually make modulation follow the structure of the software rather than the changing character of the music.
Live control reverses that relationship. The musician does not see the completed movement. There is only the current sound and the possibility of changing it. The gesture unfolds at the same speed as the music. A decision cannot be separated from the moment in which it is made.
That does not automatically produce a better result. A live gesture can be clumsy, poorly timed or excessive. Performance introduces risk as well as expression. Yet that risk is part of the difference. The musician must judge the effect while it is happening, without knowing exactly where the movement will end.
Several parameters can belong to one gesture
Plugin interfaces divide sound into separate controls. This is necessary for editing, but it does not always reflect how a musician hears a change. A sound may appear to become more distant, more unstable or more exposed, even though several parameters are responsible for that impression.
When those parameters are automated separately, one musical idea becomes a collection of individual curves. Each movement can be controlled precisely, but their relationship has to be built step by step. The producer works from the controls towards the musical result.
A multidimensional controller makes it possible to work in the opposite direction. Several parameters can respond to one continuous gesture. The musician does not need to think of each movement as a separate task. The gesture is heard as a change in the sound as a whole.
This is not simply a matter of controlling more parameters at once. The relationship between them becomes part of the movement. A change of direction affects them together. Speeding up alters the complete transformation, not just one element. The performer begins to recognise areas and paths within the control surface, much as an instrumentalist learns where certain sounds can be found through particular movements.
A good mapping therefore does more than connect controls. It creates a space that can be learned. The result of a gesture should be clear enough to predict, but open enough to allow variation. When the relationship is too simple, the controller adds little beyond convenience. When it is too complex, the performer loses the connection between action and sound.
Expression needs freedom, but it also needs something to push against.
The value and limits of touch
A touchscreen has no physical knobs, faders or fixed positions. That can be a disadvantage. The performer cannot feel where a control begins or ends and may need to look at the screen more often. Precise movements can also be harder when there is no physical resistance.
At the same time, the absence of fixed controls allows the surface to behave differently for each instrument or effect. A large area can be used for one continuous gesture instead of being divided into rows of identical controls. Several fingers can act at the same time, and the relationship between their positions can become part of the performance.
This makes touch especially suitable for movements that are difficult to divide into separate actions. One finger can hold a sound near a stable point while another slowly changes its character. Two gestures can move independently, cross or temporarily influence different parts of the sound. The surface is less like a mixer and more like a field in which movement has consequences.
Touch is often described as intuitive, but that word can be misleading. Placing a finger on a screen is easy. Performing with control is not. The musician still has to learn how far to move, how quickly the sound responds and which areas produce useful results. A touch interface becomes an instrument only when those relationships become familiar enough that attention can move away from the screen and towards the music.
The same applies to latency and response. When the sound follows the hand too slowly, the performer begins to anticipate the system rather than respond to it. The gesture loses its directness. A close connection between movement and sound is therefore not a luxury. It is what makes live modulation feel playable.
When a performance becomes a loop
Recorded gestures occupy an interesting middle ground. The movement begins as a performance, with all the timing choices, hesitations and corrections that happen while playing. Once it is repeated, it becomes an automatic process.
A looped gesture can still retain a human shape. It may contain uneven pacing or a change of direction that would be unlikely to emerge from a standard waveform. Its beginning and end may not divide time neatly. When repeated against the rhythm of the track, it can create shifting relationships rather than a fixed pattern.
Yet a recorded gesture does not remain expressive simply because it was once performed. After recording, it no longer listens. It repeats the same decisions regardless of what happens around it. Its character now depends on how the musician uses it.
Changing the speed can move the gesture in and out of alignment with the musical pulse. Altering its range can bring it forward or reduce it to a subtle layer. Interrupting it before the expected return can make the loop feel active again. The recorded movement provides continuity, while live decisions determine whether that continuity still belongs in the current moment.
This combination can be more useful than choosing between automation and performance. A gesture can establish an evolving background, leaving the musician free to intervene only when the music calls for it.
The role of the performer
Automated modulation is good at maintaining behaviour. It can keep a sound moving for as long as necessary, repeat detailed relationships and create patterns that would be difficult to perform continuously. It forms part of the instrument or arrangement.
A performer does something else. A performer interprets the present moment. The music may have been prepared carefully, yet the balance of a passage can change as it unfolds. A sound may occupy more space than expected. A transition may need to be delayed. A movement that worked in rehearsal may feel too obvious in the final take.
Live modulation allows these judgements to affect the sound directly. The musician does not have to reject structure. The programmed systems can continue to provide rhythm, detail and internal movement. Performance can operate above them, changing direction when needed.
The most interesting results often come from this combination. Automated modulation creates a world with its own behaviour. Human control decides when that behaviour should be followed and when it should be disturbed.
Modulation as musical action
TouchMod was developed around this idea. It does not attempt to replace the modulation systems inside an instrument or effect. Instead, it gives the performer direct access to plugin parameters through a multitouch surface. Several related changes can be controlled as one gesture, while movements can also be recorded, repeated and altered during playback.
The point is not that touch can create shapes that automation cannot. Given enough time, most gestures can be reconstructed as curves. The difference lies in how the movement comes into existence.
A programmed modulation says what will happen. A performed modulation asks what should happen now.
That question changes the role of the musician. Modulation is no longer only something designed before the sound begins. It becomes a way of responding to what the music is doing: holding back when a change would arrive too soon, continuing after the rhythm suggests stopping, or moving at a moment that has emotional meaning even though it does not fall on the grid.
When modulation follows attention rather than habit, it begins to resemble phrasing. It can breathe, hesitate, resist and release. It becomes more than movement within a sound.
It becomes a musical action.