catecophony

download | code | video

Catecophony is a VST3/AU plugin that performs real-time corpus-based concatenative synthesis. Given some source audio (the corpus) which is split into thousands of grains and analysed, it attempts to recreate an incoming audio stream (the target) using the corpus grains. The result is pointillist sound shapes that are often chaotic and sometimes lovely.

Catecophony is implemented using JUCE augmented with Essentia for feature extraction. It searches the grain space quickly in real-time using a k-d tree.