real-time pointillist sound collage

download | code | video

Catecophony is a VST3/AU plugin that performs real-time corpus-based concatenative synthesis. Given some source audio (the corpus) which is split into thousands of grains and analysed, it attempts to recreate an incoming audio stream (the target) using the corpus grains. The result is pointillist sound shapes that are often chaotic and sometimes lovely.

The GUI of Catecophony

Catecophony is implemented using JUCE augmented with Essentia for feature extraction. It searches the grain space quickly in real-time using a k-d tree.