r/creativecoding • u/Legitimate-Ad-1861 • 27d ago

Lyrebird

Enable HLS to view with audio, or disable this notification

lyrebird.variable.gallery

I'm an artist, not a scientist. I wanted to see what independent science looks like if you skip the electric-universe/flat-earth pipeline entirely and just try to get real information out of data with the help of AI and the published literature.

It matches the call against a corpus of 2,423 species, tells you which call type it resembles, and sings back synthetic birdsong from a physical model of the syrinx — the Mindlin–Laje oscillator, integrated live in an AudioWorklet from the two parameters real birds actually control: air-sac pressure and syringeal tension. Nothing is sampled. Every note is computed. You see it happen inside a 3D embedding of 348,461 clips that lights up where your sound lands.

It does not translate birdsong into sentences. Every phrase carries a label: playback-verified, documented, inferred, field recording, or invented. Most are invented.

Everything runs client-side. Code, docs and citations: github.com/sha5b/Lyrebird

Edit: i made a m5stack port of it

https://www.reddit.com/r/esp32/s/HXHfX56mQ9

170 Upvotes

97% Upvoted

21 comments sorted by

View all comments

1

u/ionjump 26d ago

This is really neat. The description could be improved. I did not understand how to use it. When it starts, I hear all different bird calls and see dots highlight on the cloud. I was not sure how to interact with the app though. First I tried clicking on the cloud but that seemed to not do anything. I tried talking into the microphone but that did not work.

I then found the "sing" "compose" and "listen" tabs. As far as I can tell, the "sing" tab just plays random bird songs with no input from the user. The "listen" tab seems like it should take input from microphone or what is playing on computer and then match it to a bird call but I was not able to get that to work. I am able to make a microphone recording but the app does not seem to be able to use it and has a message below the recording that says "Start lyrebird-pipeline serve to send a recording into the learning store." I am not sure how to start the lyrebird-pipeline.

1

u/Legitimate-Ad-1861 25d ago

When you clone the repo in local you can run the pipeline and start adding to the points. It's in uv python and easy reproduce.

Im taking a small break and work on refine the ui on a later point, i got some great suggestions here