FFglitch, FFmpeg fork for glitch art

Posted by captain_bender 10 hours ago

FFglitch, FFmpeg fork for glitch art(ffglitch.org)

172 points | 26 comments

dylan604 5 hours ago|

I love how we try to recreate things that are errors to add realism to something too clean. I've spent many hours in front of tape machines from analog to digital, and each format has its peculiarities when glitching. The analog formats had drop outs and other noise from the analog nature as well as things like head switching. There were also the various methods of drop out compensation like BCSP that would repeat the last good line which could lead to some interesting "smearing". Then there are other things that get imitated like when a monitor would lose sync and you'd see the horizontal/vertical blanking rolling through the screen or lose one of or swap the UV channels. The digital tape formats that had DCT blocks started displaying what this glitch art is inspired by (for lack of better phrasing). So for someone this "inside baseball", it would be a problem when these issues happened so it takes a second to get over the initial "oh no that needs to be fixed" to "that looks cool!"

v9v 51 minutes ago||

"Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distortion, the jitteriness of digital video, the crap sound of 8-bit - all of these will be cherished and emulated as soon as they can be avoided. It’s the sound of failure: so much modern art is the sound of things going out of control, of a medium pushing to its limits and breaking apart. The distorted guitar sound is the sound of something too loud for the medium supposed to carry it. The blues singer with the cracked voice is the sound of an emotional cry too powerful for the throat that releases it. The excitement of grainy film, of bleached-out black and white, is the excitement of witnessing events too momentous for the medium assigned to record them." -Brian Eno

floam 49 minutes ago||

Composer William Basinski’s deteriorating analog tape loops: disintegration loops

https://m.youtube.com/watch?v=mjnAE5go9dI

mmcclure 9 hours ago||

Not a lot of info on the page about the process, etc, but this is also called "datamoshing." If you're curious, there's a great talk from Demuxed '21 on some of the details: https://www.youtube.com/watch?v=Qtia43DGSrY

jcynix 49 minutes ago||

There's also the Glitch Lab app on Android and the author has a number of tutorial videos available:

https://youtube.com/playlist?list=PLnfdj-gV14N5JTGybk4kkVpyL...

ttoinou 40 minutes ago||

My favorite datamoshing video is from 2010 before it was cool

Apres le feu de Jacques Perconte

https://www.jacquesperconte.com/oe?28

MitPitt 7 hours ago||

Awesome! I remember seeing Datamosh 2 plugin for After Effects, but didn't know it used this open source project. Turns out there is a whole bunch of GUIs for ffglitch: https://ffglitch.org/frontends/

jedbrooke 2 hours ago|

there used to be a running joke in the AfterEffects subreddit that 95% of “What’s this effect called?” questions the answer was datamoshing. I think they even had a bot that would auto answer with datamoshing since it was asked so frequently.

tentacleuno 10 hours ago||

This page doesn't explain what FFglitch does, or how it's different to ffmpeg. For instance, what's Glitch? I'm guessing it's an architecture, but the post doesn't explain what it is or contextualize the term "architecture."

bawolff 10 hours ago||

From what i understand "glitch art" is using compression artifacts and encoding errors as art.

Presumably ffglitch is ffmpeg with code to fudge the file checksums so that encoding errors are allowed to accumulate instead of triggering an error.

mamonoleechi 1 hour ago||

>https://en.wikipedia.org/wiki/Glitch

>Television glitch --> In broadcasting, a corrupted signal may glitch in the form of jagged lines on the screen, misplaced squares, static looking effects, freezing problems, or inverted colors. The glitches may affect the video and/or audio (usually audio dropout) or the transmission. These glitches may be caused by a variety of issues, interference from portable electronics or microwaves, damaged cables at the broadcasting center, or weather.

On computers, those happens when some of the data (video, audio, image) is corrupted or lost.

Glitch art: some of those glitches create cool effects that you can see a sort of photoshop filter ; ffglitch helps you corrupt files/create those effect for artistic purpose.

You can see cool examples of glitch video art there: https://ffglitch.org/gallery/ ; they show the original clip, and then the glitched version

---

You can also have corrupted sounds, you can check 'The Glitch Mob' which is an group creating music, with samples that sounds corrupted.

fishgoesblub 10 hours ago||

The clearly labeled "What?" button at the top of the page explains everything.

hiccuphippo 9 hours ago||

The what button doesn't explain much.

As far as I know, "glitching" is opening a jpeg file with a text editor then deleting random ranges of characters, saving it again and then letting image viewers try to open the file, resulting in artifacts being added to the image.

This project seems to do the same for video files, but generating a valid video at the end.

thenthenthen 6 hours ago|||

That is “data bending” (borrowed from “circuit bending”; e.g. opening a toy that makes sound and using ‘a moist finger’ probing the pcb for changes in sound). Glitching is the intentional act of introducing errors in hardware or software, to expose the inner workings (in the case of Glitch art, this was the original aim, to expose ‘the ghost in the machine’). Rosa Menkman wrote extensively about Glitch Art here: https://beyondresolution.info/Glitch-Studies-Manifesto

shit_game 6 hours ago|||

The best way I've come to describe glitch art in my papers or talks with peers is that a "glitch" in the context of glitch art is the deliberate abuse of a format of media, taking advantage of either noise, compression schemes, or undefined behavior to produce media that would otherwise not exist (due to contraints of, say, a compression algorithm and a binary format like JPEG), or to reproduce media that is discarded by these (and other) mechanisms of the format (The Ghost in the MP3[0] is a fantastic, and arguably the pioneering work in this regard).

Formats such as circuitbending are alien to me, as I primarily work with digital and occasionally analog photos and videos, but generally follow the same principles of breaking away from intended use of some set of rules to express illegal states.

0. https://www.theghostinthemp3.com/theghostinthemp3.html

BoardsOfCanada 6 hours ago||

At university we implemented a DCT+quantization encoder/decoder for audio, and had a buggy version produce these super alien, beautiful sounds. I've often wished I had saved that version.

maxglute 1 hour ago||

Nice, watching too much datamosh / glitch art makes my brain tetris effect glitches in my dreams.

bawolff 8 hours ago||

You know, i was all ready to be dismissive of this, using encoder errors for art sounds silly.

But i watched the video and it really was cool and artistic.

shit_game 6 hours ago||

Plenty of incredible works of art and story telling use glitch art to evoke feelings and notions of "brokenness" or surreality. Some pieces that come to mind are Adventure Time S5E15: A Glitch is a Glitch, created by artist David OReilly[0] and the music video for A$AP Mob - Yamborghini High made by editor Uncle Luc[1].

This of course doesnt even begin to touch on the influences glitch art has had on music and audio - it's arguable that glitch art has its origins in printing, photography/film, and in electronic music, but most deliberate uses of "glitches" as artistic vehicles tended to arise during the early eras of electronic music production. Rosa Menkman speaks in depth about the origins of glitch art in the music scene in her paper The Glitch Moment(um)[2].

0. https://rhizome.org/editorial/2013/apr/25/datamoshing-land-o...

1. https://www.youtube.com/watch?v=tt7gP_IW-1w

2. https://mediarep.org/server/api/core/bitstreams/b16c898a-c6b...

epiccoleman 5 hours ago||

The quintessential example of glitch art, imo, is Adult Swim's Off the Air, which compiles various short animations and music cut together with various datamoshed transitions. While the glitch stuff isn't always the central focus it definitely goes a long way towards setting the trippy vibe they're going for.

There are too many excellent episodes to list but Animals is a great one to get a feel: https://youtu.be/59QBOO6m210

And the Dan Deacon USA special episode might be peak Off The Air:

https://youtu.be/9X4fYP9bqqw

mamonoleechi 1 hour ago||

It can sound cool with music too:

- https://en.wikipedia.org/wiki/Glitch_(music)

- group: the glitch mob http://www.youtube.com/watch?v=frfs4tkN-AY

jedbrooke 2 hours ago|

cool art! seeing datamoshing like this always impresses me at how much motion is encoded in modern video codecs

More comments...