Top
Best
New

Posted by simedw 10 hours ago

Show HN: I trained a 125M model to autocomplete piano on-device(simedw.com)
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15).

The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device.

The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

455 points | 101 commentspage 4
oleggromov 6 hours ago|
This is almost exactly what Jordan Rudess is doing now with some folks from MIT or Stanford right now. Google his interview with Rick Beato.
h2aichat 6 hours ago||
Congratulations! It is amazing!!! Can you do the same with a song and give different drums to see which one fits better?
dyzone 5 hours ago||
I wonder if training SOTA models on this will make them more humane?
luciana1u 4 hours ago||
next step is a model that autocompletes the part where you actually practice. mine just sits there judging my scales.
arkmm 9 hours ago||
Very cool! Can you say a little bit about the size of the DPO training examples and how long training took?
simedw 8 hours ago|
For DPO I only had around 700 preference examples, so not much data at all. That took about 12 minutes to train on a single GPU.

Pretraining was obviously a a lot slower, the 125M model took roughly half a day.

theschwa 7 hours ago||
Would you be willing to share about how much it cost to train a model like this?
simedw 7 hours ago|
Luckily I have access to 4x RTX 4090s, so I didn’t have to pay cloud GPU prices directly. If I had, it probably would have added up quite a bit given how many training runs and experiments I ended up doing.
yoouareperfect 10 hours ago||
This is really awesome thanks for sharing
the_black_hand 8 hours ago||
Cool work. I tried using LLMs to parse sheet music and they are really bad.
Naitik88 8 hours ago|
[dead]
bilsbie 7 hours ago||
Should tokens be multiple Midi notes? Why or why not?
More comments...