• 0 Posts
  • 15 Comments
Joined 3 years ago
cake
Cake day: June 19th, 2023

help-circle
  • Curating massive music libraries. I’ve been using a small embedding model to organise my music for DJing, and being able to generate a t-sne plot clustered on perceptual similarity has been wonderfully useful.

    I’ve also found CLIP models useful for searching videos, just embed a screenshot every couple of min of footage and query with a description of the scene.

    And as bad as generated subtitles can be, when the only other option is nothing at all they are pretty nice to have.


  • Makehuman for generating models, unity preview renderer running as an MCP tool, language model reads page instructions for pose info, low frequency noise on pose bones to add micro movements.

    Bots have had a workaround for weeks now. Same with browser movement bot detection, just train a behavioural cloning model on human mouse movements, and use that to create mouse trajectories instead of directly moving the cursor to the target position.





  • I’m going to throw my own thoughts in on this. I got into machine learning around 2015, back when relu activations were still bleeding edge innovations, and got out around 2020 for honestly pretty similar reasons.

    Emotions can and have been used as optimisation targets. Engagement is an ever present target. And in the framework of capitalism, one optimisation targets rules above all others; alignment with continued use. It’s part of what leads to the bootlicking LLM phenomenon. For the average human, it drives future engagement.

    The real danger isn’t the newer language models, or anything really to do with neural net architecture; rather, it’s the fact that we’ve found that a simple function minimisation strategy can be used to approximate otherwise intractable functions. The deeper you research, the more clear it becomes that any arbitrary objective can be optimised, given a suitable function approximator and enough data to fit the approximator accurately.

    Human minds are also universal function approximators.








  • If you want that long tail, bandcamp and soundcloud are better sources. The barrier to entry is low with those, and there’s a plethora of small, niche artists just doing their own thing.

    For a representative snapshot of music though, it’s pretty amazing. It shows what a massive percentage of the planet listens to, preserved hopefully across many seeds, and historians will love shit like this in the future.