Stefano D'Alessio

TL;DR

  • What’s Ploc’?
  • Max9 intro
  • What are the ste.snips and how they work
  • Using the ste.snips to create interaction between body and sound

If you prefer text… below you find a list of the video’s key concepts… with images…

Introduction & Context

  • The ste.snips is a Max package of snippets for audio, video, 3D, and interaction.

  • Emphasis on embodied media instead of traditional interfaces.

Max Basics (Quick Orientation)

  • A patcher is a Max file where everything happens.

  • Two modes:

    • Unlocked → edit, add objects, connect cables.

    • Locked → interact with UI elements.

  • Essential shortcuts:

    • Cmd/Ctrl + E → lock/unlock patch

    • C → comment

    • N → object

    • B → button

    • I → integer number box

    • F → float number box

  • Strong emphasis on commenting patches with comments boxes for future clarity.

Core Max Concepts

  • Objects: pre-programmed modules that receive input and produce output.

  • Inputs are on top, outputs on the bottom.

  • Example workflow:

    • Button → random → number box

    • random 10 outputs values 0–9.

  • Difference between:

    • Integer numbers (whole values)

    • Float numbers (decimals)

  • Message boxes:

    • Can store text, numbers, or lists.

    • Can be triggered manually or by other objects.

hot tip

When changing the value of a float number box by click and drag, beware that precision depends on cursor position, placing the mouse cursor to the right of the number box gives you more precision

Logic & Control Example

  • Using select to trigger different outputs based on incoming values.

  • How logic flows through Max:

    • Random number → select → triggers messages (pizza example 🍕).

  • print object used to debug and view results in the Max Console.

hot tip

the [messageview] is a brand new object that can be used for printing and displaying inside the patcher window, so you don’t need to keep the Max Console open

Audio, Video & Data Types

  • Different object families:

    • Max → general logic

    • Jitter (jit.) → video / graphics

    • MSP (~) → audio

  • Audio objects end with ~ (e.g. click~, dac~).

  • Cable colors indicate data types:

    • Audio, video, multichannel audio all look different.

  • Audio must be enabled in Options / Audio Status and set to the correct output device.

Introduction to ste.snips

  • Snippets are pre-built, user-friendly modules that open in their own windows.

  • They provide:

    • Immediate functionality

    • Built-in UI

    • Descriptions and editable internals

important

Do not use the Max patcher in full screen while working with snippets

Camera & Movement Tracking

  • Drag and drop snippets from the snippets menu:

    • ste.pixCam → camera input

    • ste.pixGetMovement → extracts motion data from video

  • The ste.pixGetMovement outputs:

    • Movement mask (black/white image)

    • Grayscale image

    • Float value representing amount of movement

  • Movement amount value increases with physical motion.

ste.starterPack Overview

  • Add a ste.starterPack

  • Always good to have it in your patches

  • It includes:

    • A 3D world / output window

    • Audio output with a sound sample

    • Autosave (strongly recommended)

  • Snippet parameters are saved automatically with the patch.

info

In the newer ste.snips version the ste.starterPack also includes a ste.folderPath to facilitate loading files in the patcher

Mapping Movement to Sound

  • Goal: control sound playback speed using body movement.

  • Use:

    • Movement value → speed attribute of a playlist object.

  • Problem identified:

    • Raw sensor data is unpredictable and inconsistent.

Scaling Interaction Data (Key Concept)

  • get the ste.inScale / ste.outScale snippets:

    • InScale

      • Normalizes incoming sensor data to a 0–1 range.

      • Auto mode learns min/max values based on user movement.

    • OutScale

      • Maps normalized values to meaningful control ranges.

      • Example: sound speed from 0.5 → 2.0.

  • Strong emphasis on iterative tuning for expressive, reliable interaction.

Visual Output & Performance Setup

  • Movement video routed into ste.3dWorld for projection.

  • Fullscreen output via esc key.

  • Output windows can be set to floating (always on top).

  • Ideal for performance setups with projectors or extended displays.

Ploc’ Workflow Philosophy

  • Keep patches:

    • Simple

    • Modular

    • Fast to modify

  • Explore different artistic results by:

    • Swapping media (audio ↔ video)

    • Changing mapped parameters

    • Reusing the same interaction logic

Final Tips

  • Always save your work.

  • Avoid spaces in file names (use _, -, or camelCase).

  • Next tutorials will focus exclusively on snippets + embodied interaction examples.

NEXT: 1.0 Control Video Speed with Movement