Explore the research side of Neural Notes and try current interaction modes.
Mike Hao Jiang and Andrew Lippman. 2026. Neural Notes: An Online Platform for Real-Time Structured Musical Improvisation Supporting Human-Human, Human-AI, and AI-AI Interaction. In Companion Proceedings of the 31st International Conference on Intelligent User Interfaces (IUI Companion ’26), March 23–26, 2026, Paphos, Cyprus. ACM, New York, NY, USA, 4 pages. https://doi.org/10.1145/3742414.3794766
Neural Notes is an online platform for real-time structured musical improvisation supporting human–human, human–AI, and AI–AI interaction. The system supports real-time improvisatory exchange with low perceived latency, situated within a structured harmonic environment defined by user-selected songs. The platform runs in any modern web browser and supports both MIDI-enabled instruments and computer keyboard input, making it widely accessible to musicians of all levels. Neural Notes provides a unified environment for co-creative musical interaction, offering researchers a living testbed for studying improvisational dynamics, AI-assisted practice, and multi-agent musical collaboration.