8. AI in the soil
Goal: the AI features as playable material, not a chat box. A camera that drives knobs, presets written from a sentence, sounds designed from a prompt.
You leave with: your hand on the filter, a preset written from words, and a kit the Sample Lab designed.
What is there
- Hands - a hand tracker: fingers, position, pinch and learned poses as MIDI and control values.
- Skeleton - the same for the whole body.
- Presets from words - Generate with AI on any preset strip's menu, and Evolve beside it.
- AI Assistant - a conversation that edits the patch.
- AI Sample Lab - sounds designed from a prompt, rendered and laid across a Sampler.
- SoundSpace - a folder of sounds mapped by timbre and flown through with a cursor.
Every language-model feature rides one provider chosen in Settings > AI: a model server on your own machine by default, or a hosted service with your key.
Steps
- Settings > AI. Point it at your local model server; the dropdown lists the models it has. Pick one.
- Hands. Add it and show the camera your hand. Right-click Acid's Cutoff and pick Hands' pinch under Control with. Open and close your hand.
- Skeleton on VideoFX's rotation, so the picture tilts with your shoulders.
- Presets from words. Open the menu on Bloom's preset strip, Generate with AI, "a cathedral under water". Then press Evolve twice.
- Assistant. Control > AI Assistant. Ask it to add a delay after Grit and set the tempo to 124. Undo takes it back.
- Sample Lab. Control > AI Sample Lab, "wooden percussion, dry and close". A card shows the progress, and the kit lands on a Sampler. Play the keys.
- SoundSpace. Drop a folder of files on it and fly the cursor.
Shot list
- Settings > AI, the model dropdown filling when the server answers.
- Hands added, the camera preview, a pinch closing the filter.
- Shoulders tilting, the picture tilting.
- The description typed, the preset landing, Evolve pressed twice.
- The assistant asked, the delay appearing, the tempo changing, undo.
- Sample Lab's card designing, then done; keys played.
- SoundSpace's map, the cursor flown through the sounds.
Go deeper
- AI tools: the provider, presets from words, the assistant, Sample Lab, SoundSpace, Hands and Skeleton.