Fast, differentiable audio processors on the CPU or GPU, controlled from the browser.
I'm still working on improvements and an interactive browser client, after which I'll write up a blog post.
In the meantime, the docs directory has several Jupyter notebooks with plenty of examples.
The Differentiable Audio Processors notebook shows many real DSP examples, along with loss/parameter time-series.
(All files under docs/scratch are working notes, and can be ignored.)
The goal of this project is to parameterize audio graphs, in real-time, to produce an audio stream resembling incoming audio.
Built with JAX, WebRTC, WebSockets, and React.
react-three-fiber provides the WebGL backbone for
performant real-time clientside monitoring of the system.
To build and run the server in a Linux container:
$ docker build . -t jaxdsp_server
$ docker run -p 8080:8080 -p 8765:8765 --platform linux/amd64 --init jaxdsp_serverSee the server README for instructions on running locally.
$ cd client
$ npm ci
$ npm run build # or, for a development build: `build:dev`$ cd app
$ npm ci
$ npm start