When The Music Follows Technical Reference
Elaboration on the technical terms used in the project When The Music Follows.
Audio DSP Terms
DSP (Digital Signal Processing)
Any effect that changes audio in real time, for example delay, reverb, distortion, or pitch shifting. In a game, this could make a voice-over sound like it comes from a radio or helmet, where the effect is generated in the engine instead of being pre-baked. It could also change the reverb characteristics when the player walks into a different room.
Granular Synthesis
Breaking sound into tiny fragments, called grains, and reassembling them at different speeds, pitches, or overlaps. Windowing is used to create transitions between the grains. Depending on the settings, granular synthesis can create smooth, dreamy pads or chaotic, swarm-like textures.
Granular Delay
A delay effect built with granular synthesis techniques. Instead of repeating the whole signal like a normal echo, it replays tiny grains with shifts in pitch, timing, or stereo width. This can create eerie, shifting echoes useful for horror, sci-fi, and alien-like sound design.
In this project, it worked through several related controls:
- Granular processing: Instead of one simple echo, this creates multiple small grains of delayed audio.
- Grain size: How long each tiny audio snippet is, like cutting audio into 100ms pieces.
- Number of grains: How many mini echoes play at once, up to 16 simultaneously.
- Grain spacing: Each grain starts at a slightly different time for more complex textures.
- Pitch shifting: Each grain can be pitched up or down independently.
- Pitch randomness: Adds chaos by making some grains higher and some lower, creating more organic textures.
- Stereo width: Controls how wide the effect spreads across the left and right speakers.
- Feedback: How much the delayed audio feeds back into itself.
Granular Wave Player
This is the name I gave to the audio feature: a granular synthesiser inside MetaSounds that can morph audio from calm pads to chaotic swarms. It was often used to create tension. The feature can follow the timing of the currently playing audio, syncing the granular player with the normal audio element. That creates extra possibilities, such as going back in time or freezing the sound while still being able to transition back to the normal audio.
Stinger
In this context, a stinger is a short burst of music or processed sound that emphasises a dramatic moment, such as a jump scare, winning a battle, or picking up a key item. DSP-driven stingers acted as musical jump scares. The term stinger is also used more generally for short sound effect or music segments that highlight a game moment or transition, optionally in sync with the music.
Shimmer Reverb
A long reverb that includes pitch-shifted echoes in its tail, often pitched up or down an octave. The result is a dreamy, haunting effect that can work well for surreal or unsettling moments, especially when the pitch is automated with modulation such as LFOs.
LFO (Low Frequency Oscillator)
A repeating signal with a defined rate and waveform that modulates other parameters, such as volume, pitch, or filters, to create motion and variation in sound.
Waveshaper
A DSP effect that alters the shape of a waveform, often adding grit or distortion.
ADSR
An envelope with attack, decay, sustain, and release stages. These four stages shape how a sound starts, holds, and fades away.
Technical Audio Terms
3D vs 2D Audio
- 3D audio: Audio tied to objects in the world. It becomes louder when closer and quieter when distant.
- 2D audio: Audio that plays evenly everywhere, like background music represented in both left and right channels.
Mixing both lets music feel partly like a soundtrack and partly like an environmental presence, creating a bridge between these two worlds.
Horizontal & Vertical Resequencing
- Vertical resequencing: Adding or removing layers, such as muting drums or bringing in bass.
- Horizontal resequencing: Jumping between sections, such as verse to chorus.
Together, these techniques let music evolve with the game while staying coherent.
Diegetic & Non-Diegetic Music
- Diegetic music (also called source music): Music that exists within the story world. The characters can hear it. For example, a band playing at a party in a movie, or a character turning on a radio.
- Non-diegetic music (also called score music): Music that exists outside the story world. The characters do not hear it; it is added for the audience’s experience. For example, dramatic orchestral score during a chase scene.
Code / Unreal Engine Terms
Spline (Unreal Engine Term)
A spline is a curve or path you can draw in Unreal. It defines how objects or characters move or progress. In this project, audio parameters were tied to splines so the music gradually changed as the player walked along a hallway.
Parameters (Triggers, Integers, Floats, Enumerators, Booleans)
Programming terms often used in Unreal Engine and MetaSounds.
- Triggers: Instant events that tell the system something happened, such as the player entering a zone or picking up an item.
- Integers: Whole numbers used for counting or setting discrete values, such as stage = 1, 2, or 3.
- Floats: Numbers with decimals, often used for continuous values that change smoothly. For example, game object proximity could be 0 when closest and 1 when furthest away.
- Enumerators (enums): Predefined sets of options, such as gameplay stage = calm / tense / extreme.
- Booleans: Simple true/false switches, such as isDangerous = true or false.
Together, these data types are the language that connects gameplay systems with MetaSounds parameters, allowing audio to react dynamically to what happens in the game.
MetaSounds
Unreal Engine 5’s modular audio system. Think of it like a virtual modular synth inside the engine, where you patch nodes together. Unlike a static soundtrack, MetaSounds lets you design sound graphs that react live to gameplay triggers and parameters.
Seeded Randomisation
Randomness controlled by a fixed seed number. Using the same seed produces the same sequence every time. This is useful for keeping randomness feeling organic while still controllable for debugging and maintaining overall control.
Blockout Level
A simple, rough level built in Unreal Engine, often using grey boxes, to test gameplay ideas and blueprint how the level will be built. It works as a guide before detailed art or polish is added.
Entities
In Unreal Engine, these are actors or objects in the game world. In this project, entities act both as possessed objects that carry unique sound behaviours and as actors in the game world.
OnCuePoint
Whenever the audio inside the WavePlayer in MetaSounds reaches a marker, it executes an OnCuePoint trigger. This is useful for syncing new audio segments or looping audio while maintaining the tail.
MetaSoundSource
A MetaSoundSource in Unreal Engine 5 is the asset that holds your MetaSound graph, similar to how a SoundWave holds a regular audio file. It allows you to build simple or complex patches for one-shots or loops, with inputs that can control parameters inside the patch.
MetaSoundPatches
Patches that can be used inside a MetaSoundSource. They work similarly to macros, containing logic that can be reused or used to keep a MetaSound graph organised and modular.
ActorComponents
Components that can be attached to an actor inside a blueprint. They can contain functionality and support management and reusability.
Miscellaneous
Weeping Angel Mechanic
Inspired by Doctor Who. Enemies only move when you are not looking at them. In this project, certain entities followed the player in this style, in an attempt to add tension through unexpected behaviour.
Wwise (Audio Middleware)
Audio middleware is software used alongside game engines to handle adaptive music and sound logic. Wwise is an industry-standard tool from Audiokinetic that offers features like resequencing, mixing, and advanced control through states and switches. It is often used in large projects, but also has broad use in other projects, including work outside of games.