witheFlow: Real-Time Emotion-Driven Audio Effects for Music Performance
A new open-source system called witheFlow modulates audio effects in real time based on biosignals and audio features, aiming to enhance human-machine collaboration in music performance. Developed as a proof-of-concept, the system runs locally on a laptop and requires a compatible Digital Audio Workstation and sensors. The project highlights the intrinsic link between music performance and emotion, arguing that machines cannot truly perform music but can augment human expression. The system extracts features from both biosignals and audio to automatically adjust effects, offering a lightweight, accessible tool for performers. The paper is available on arXiv under computer science and sound categories.
Key facts
- witheFlow is a real-time emotion-driven audio effects modulation system.
- It modulates audio effects based on biosignals and audio features.
- The system is in proof-of-concept phase.
- It is open-source and runs locally on a laptop.
- Requires a compatible Digital Audio Workstation and sensors.
- The paper is published on arXiv under Computer Science > Sound.
- The system is designed to enhance human-machine collaboration in music performance.
- The project argues machines lack capacity for affective experience.
Entities
Institutions
- arXiv