Freelance
TouchDesigner Developer for Real-Time MIDI-Driven Visual System
TouchDesigner Developer Needed for Real-Time Data-Driven Visual System
I am seeking an expert TouchDesigner developer to build a real-time visual system for an artwork that receives live or recorded outputs from an existing code and data pipeline, including MIDI, and translates them into refined data-driven visuals. The system must also support recording, replay, and a safe demo mode for situations where live input is unavailable.
This is a per-project engagement, with potential follow-on milestones or hourly support after initial delivery. I am interested in starting immediately.
Project Overview
I am an artist developing a new real-time audiovisual artwork and research-driven performance-installation in collaboration with a musician. I am looking for a highly skilled TouchDesigner developer or creative technologist to build a modular TouchDesigner layer for this project.
The current system produces MIDI outputs that can be used to drive visuals. There may also be related CSV, event, or raster data available for later integration. For this first phase, the priority is TouchDesigner visualization, interface design, integration, recording, and replay.
I am familiar with TouchDesigner and coding and can work with the system collaboratively, but I am not an expert. I am seeking someone with strong experience in real-time systems, MIDI, data-driven visuals, installation-oriented creative technology, and clean, editable project handoff.
Technical Context
This project connects to the Cortical Labs API and SDK ecosystem:https://github.com/Cortical-Labs/cl-api-doc/
The existing Python pipeline uses the Cortical Labs simulator and cloud-ready architecture to stimulate living-neuron networks, receive neural activity back as data and MIDI, and provide the real-time input and output layer that this TouchDesigner system will visualize, record, and replay.
I can share the current codebase, MIDI outputs, and additional technical materials privately with shortlisted candidates to review and determine fit.
Visual Direction
The visual system should feel immersive, conceptually strong, and organic, with a somewhat biological or cellular quality. I am interested in refined, fluid, high-resolution, data-driven visuals with elegance, flow, and strong real-time responsiveness.
Reference links:
What Needs to Be Built
A TouchDesigner system that can:
-
Receive live or recorded MIDI and translate it into visuals
-
Be designed so it can later also accept raw neural, event, or CSV data without needing to be rebuilt
-
Include at least three visual modes
-
Support recording and replay
-
Be modular, clearly labeled, and fully editable
-
Be delivered in a form that I can continue using, modifying, and building on myself, with nothing locked
Required Visual Modes
1. Event / Spike ModeA mode that visualizes MIDI or spike events clearly, such as pulses, particles, nodes, or grid-based activity.
2. Field / Aggregate ModeA mode that shows overall system behavior, density, emergence, or collective activity as a continuous field or flow.
3. Audio-Reactive / Interaction / Dialogue ModeA mode that helps make visible the relationship between input or stimulation, neural response, and output.
Technical Direction
Phase 1 input should be MIDI.
The architecture should support later input from:
-
CSV
-
Event streams
-
Raw neural data
Everything should align to a shared timeline or session clock for recording and replay.
The visual system should not only respond to data, but also help make visible the evolving exchange between neural activity, computational translation, and output.
Suggested or Desired Mappings
I am open to discussion and your recommendations if you have a strong systems-based approach.
Potential mappings include:
-
MIDI note or pitch to spatial position
-
Velocity to intensity, brightness, scale, or particle emission
-
Note-on to triggered events
-
Duration to decay or persistence
-
Activity density to overall field energy
-
Audio amplitude or spectrum to motion, scale, or transformation
Deliverables
-
Complete TouchDesigner project file (.toe), fully editable and unlocked
-
All linked assets, scripts, custom components, and dependencies
-
Clear folder structure and naming
-
Simple README or setup guide
-
Video screencast walkthrough explaining project structure, logic, controls, and how I can edit or extend it
-
At least one demo recording of the system running
-
Three rounds of revisions included
-
Clean handoff with full reuse and modification rights for my project
Important Handoff Requirements
-
The project must be fully accessible and editable by me
-
Please do not deliver a locked or opaque system
-
Please clearly label major containers, modules, and controls
-
Keep everything organized
-
If third-party components are used, they must be disclosed in advance and must be open source
-
Please include a safe demo mode that runs without live input, using recorded MIDI or sample data
Nice to Have, But Not Required for Phase 1
-
CSV, JSON, or event log ingestion
-
Annotation markers
-
Timeline overlays
-
Light Python integration
-
Logging hooks
-
OSC or similar live data integration
To Apply, Please Send
-
A short note on why you are a fit
-
Portfolio link(s) to your most relevant TouchDesigner work
-
Two to four examples specifically relevant to:
-
real-time systems
-
MIDI, sensor, or data-driven visuals
-
installations or performance systems
-
-
A short note on how you would structure this project
-
Your estimated timeline and cost
-
Whether you can work from an existing code or data pipeline
-
Whether you reviewed the links above, and your brief thoughts on them
-
Whether you can deliver a safe demo mode when the live system is not running
-
Your availability to start immediately
Please do not apply unless you have strong TouchDesigner experience with real-time input, structured systems, and editable handoff.
All work created under this project shall be deemed a work made for hire, with full ownership, rights, and title vesting exclusively in Amy Karle.
If you want, I can also turn this into a tighter version for Upwork, a more curator-facing version, or a more legally protective commissioning brief.
http://www.amykarle.com/contact
