Top
Best
New

Posted by neogenix 3 hours ago

Show HN: YouTube Guitar Tab Parser(github.com)
I created a simple CLI that turns a YouTube guitar-lesson video into a PDF of the guitar tab.

There are services that transcribe music from Youtube videos into tabs, but they never work well enough for me. Instead I'm taking a simpler approach. It downloads the video, samples frames, uses Claude vision to locate the tab region, crops every frame to that region, de-duplicates the crops by the bar number printed on each line of the score, and stitches the distinct tab lines vertically into a PDF.

I didn't test it on a lot of different Youtube videos yet, so problem will arise for sure.

54 points | 40 comments
gste 1 hour ago|
So I'm a bass guitarist, and I've made some of these exact videos.

I link to a Patreon in my videos that lets you pay a membership to download the full tabs in PDFs.

Here I was thinking AI might soon replace my painstakingly slow tab transcription efforts altogether. But I never thought about someone just ripping it from the video...

Let me know if it works ;-)

https://www.youtube.com/watch?v=c2i-Lwoe2Ow

adrianh 3 hours ago||
I'm curious how it works for videos that contain moving tab (as in, the playhead stays in the center while the tab moves behind it). Seems like that sort of tab wouldn't work with this approach...?

Kudos from one of the Soundslice guys — we've been making web-based tab and sheet music stuff since 2012. :)

mschulkind 2 hours ago||
I don't have an answer, but wanted to say that I started using Soundslice about 9 months ago and I absolutely love it. It does exactly the part of transcribing that I want done for me and nothing more, which is basically none of it except the boring stuff.
adrianh 1 hour ago|||
Hey, great to hear! Thanks for taking the time to write that. :) Keep transcribing and playing music!
devin 1 hour ago|||
Care to sell me on it? How dose it compare to musescore?
neogenix 3 hours ago||
It wouldn't work for that type of video. As far as I've seen almost all tutorial videos on Youtube have a fixed tab bar though. I'm using it only for learning guitar (i'm a beginner).
deckar01 40 minutes ago||
I’ve been working on a tool to help me discover chord inversions and find fingerings I can comfortably play. https://music.shademaps.com/
shermantanktop 1 hour ago||
I learned this one:

https://m.youtube.com/watch?v=07N4VVSmYLU&list=RD07N4VVSmYLU...

…exactly the way you described. Pause, screenshot, adjust color/contrast, assemble in a pdf. Super annoying.

worldsavior 3 hours ago||
I don't know how exactly Claude vision works but isn't just using good old computer vision much cheaper?
neogenix 3 hours ago|
Yes, for sure. You could probably train a specific vision model for this style of image parsing and run it on device for free. However, this was much easer to make :-)
cwt137 2 hours ago||
It would be nice to have a link to an example YT video to see what exactly the AI is trying to locate on the screen.
XCSme 2 hours ago||
I was excited to use it, as I really wanted something like this, then I realized it needs AI/Claude (?)

That sounds like it can get quite costly. Probably there are ways to do it without AI, I would rather manually annotate the tab area with a visual editor.

motoxpro 1 hour ago|
How would you do this without SOME sort of vision/audio model? Are you saying just not an LLM?
XCSme 46 minutes ago||
Manually select a rectangle on a video frame, then do basic computer vision to detect notes, or even a simple image processing algorithm to find the lines and notes.
dieselgate 2 hours ago||
Are there technical hurdles around just programmatically generating a tab from any song or audio recording itself?

This is interesting and all but seems to use computer vision rather than audio processing?

lokar 18 minutes ago||
Reddit r/guitar gets a lot of questions about AI generated tabs that are unplayable (the fingering is just crazy).

You need to both work out the chords and also decide on fingerings a human could perform. Seems possible, but more then just audio processing

gcy 51 minutes ago|||
As far as I know, there still isn’t a tool that can reliably produce usable transcriptions out of the box, although the results for solo piano can be reasonably good. A lack of high-quality labeled training data, especially for instruments other than piano, is probably part of the reason. But the problem is also more complicated than it might initially seem: you have to handle polyphony, overlapping harmonics, timing and articulation. And in the case of guitar tabs, it's even more complicated as one needs to determine what tuning is used (if not standard), which string and fret produced each note. Or separately rearrange the tab.
simonok 1 hour ago||
Using computer vision to read the existing tab from the page would be more efficient and precise than trying to use audio processing to isolate individual notes from a single instrument in a potentially busy audio track. The existing tabs also nail down which string and fret is used for each note, which would be a difficult task for audio processing because there are multiple combinations of string and fret for any given note. For example, an open G can also be played on the 5th fret of the D string, or the 10th fret of the A string, or the 15th fret of the E string.
dieselgate 51 minutes ago||
I understand but would assume it could be solved by chord/positional groupings or similar. Manual/human tab transcription need to infer positional assumptions anyway; some artists will play the same songs different ways too ala Bob Weir

> the existing tab from the page would be more efficient and precise

But what about songs that aren't made into a YT video?

blaufast 32 minutes ago||
Thank you!
Diogenesian 2 hours ago|
Almost all those people charge for the PDFs. They know the PDF is more useful, that's why the video is free.

I don't think your software is (or should be) illegal. But it's a form of theft, and incredibly unethical. These people worked very hard on these tabs and don't make much money. You (and kiaansaraiya and neogenix) should be ashamed of yourselves. You don't deserve your guitar if you steal tabs from working musicians.

breaker-kind 2 hours ago||
counterargument -- these people are making money off of transcribing other people's parts, with no profits shared with the composers.
shermantanktop 1 hour ago|||
No.

In some cases, the composer makes the video, and is sharing their own work.

In other cases, the transcribed part is not a composed part, and the composer who is listed (Lennon/McCartney) did not write or perform it (e.g. Ringo's drums).

In yet other cases, the composer was long dead before the recording was made, and the melody being transcribed is meaningfully different than the one they composed. Common in jazz.

"Composer" is a 19th century idea, enshrined in copyright law in the 1920's in order to protect the people who made sheet music for piano players to play in their parlor. Musical expression deserves attribution and protection, but let's not pretend the name on the liner notes is a Beethoven with a long quill creating a work of genius out of their solo effort.

Diogenesian 2 hours ago|||
That's a bad counterargument. Transcribing is transformative. Copying a video into a PDF is not.
almostjazz 2 hours ago|||
I'm not a lawyer but based on some googling it seems like the overwhelming consensus is that selling transcribed sheet music or tabs if you do not have permission from the copyright holder of the song is illegal.

https://www.thatgreatcomposer.com/blog/is-it-legal-to-transc...

https://law.stackexchange.com/questions/96352/dual-question-...

https://www.drumforum.org/threads/what-is-the-legal-basis-fo...

dahart 3 minutes ago||||
> Transcribing is transformative.

Not under US Copyright Law, it isn’t. Transcribing is derivative, not transformative.

akramachamarei 2 hours ago|||
As an occasional amateur music transcriber I'd say the goal of transcription is not transformation. If I'm transforming, I've failed :)

Inevitably the transcriber makes decisions in how to deviate from the reference recording, be it omission of instruments, microchanges in tempo and pitch or articulation. In theory a good transcription is an exact graphical representation of the abstract sonic intent of the artist.

Of course, if you are combining voices, changing chords, it approaches an arrangement which is a more creative endeavor.

rc5150 2 hours ago||
"you don't deserve your guitar if you steal tabs from working musicians"

the same "working" musicians who didn't write the music they're making tabs for, didn't get any permission from the original artists, and in many cases aren't actually playing/tabbing the parts as originally written.

A "working" musician is someone who doesn't monetize someone else's work, regardless of how super hard it must be to write a PDF.

I'd say someone should take your guitar away but I'd bet money you're not doing anything groundbreaking with it anyway.

earthnail 2 hours ago||
But then the solution is to just ignore these musicians.

But if you do find that they made something valuable that you can’t find elsewhere, then you should compensate them for that. Because yes, it is a lot of work.

More comments...