Search the Community

Hi gang. Question: Has anyone thought about sync MIDI to scene events? MIDI sequences allow insertion of SYSEX messages... and often these SYSEX messages (among the note on/off data)... contain something called MMC... midi machine code... used to automatically turn knobs/adjust settings... on certain midi playback gear (such as soundcards and midi synthesizers). But we demented experimenters... would LOVE to access those sysex messages... and make our 3D mesh do things... at that playback time. We (I) want to make my mesh... dance to the beat of the midi song. If I insert sysex messages into my midi song, and IF I can "see" those events happen with a scene observer... that would just TOTALLY ROCK! (literally!) I know @davrous is a musician/composer, and he knows some seriously-advanced stuff about JS audio. I hope I can "entice" him to come aboard this cause. Also, I don't want to use code to play the song, noteON-by-noteOFF. Ideally, I want to insert an HTML <audio> element into the dom tree, and if the song contains sysex messages of type-BJS, I want them to activate sysexMessage observers in the scene. Would THAT be cool, or what? You ain't NEVER seen "Mesh'n'Light Shows" like the ones Mr. Wingnut could produce... if that "choreography system" was operational! YUM! UberYUM! Ok girls... can it be done? Is there a wall to cross? A river to ford? Do we have the bridge-making gear? Thoughts welcome... any thought from any one. Thx! (Again, let's NOT make scene code play (poke) each note, step-by-step. That type of system will not stay in-tempo. Let's avoid that idea.)