The #GTK4 demo video player in full pass-through mode. We're getting there!
In case you wondered how things look on AMD: this is BBB 4K@60FPS and the corresponding radeontop report.
If you want to reproduce:
The main #gkt4 MR just landed (https://gitlab.gnome.org/GNOME/gtk/-/merge_requests/6533) \o/
I use a small patch to make the demo video player use it (https://gitlab.gnome.org/rmader/gtk/-/tree/dmabuf-texture-gst)
If you want to test direct-scanout (full zero-copy) on #GNOME Mutter, you'll need https://gitlab.gnome.org/GNOME/mutter/-/merge_requests/3177 on top of main.
The rest is plain #Fedora39
@rmader stupid question: what is full pass through?
@appelgriebsch @matzipan zero-copy might be a more intuitive term here. It means the buffers produced by the hardware video decoder travel through #GStreamer and #gtk4 to the #Wayland compositor - which then can often directly put them on screen, the render/3d engine being completely idle.
The last step is not pictured here as the terminal is on top of the video (and unfortunately the hardware doesn't support it - all generation after Skylake do, AFAIK).
P.S.: systemd here is actually Mutter.
@rmader @appelgriebsch ah so the screenshot shows no render/3d activity. Cool!
@rmader This is amazing! Thank you!
@rmader I'd like to have a better idea of how big of a difference this is compared to what we've been seeing so far in terms of offloading video to the GPU / avoiding the CPU… what codec and resolution is that video (i.e. decoding complexity)? How does it compare to Firefox's decoding on that machine with that video?
@nekohayo I wrote about it a bit more in detail here: https://floss.social/@rmader/111142297368297062
@rmader are you sure hardware video decoding is working on the AMD? Everything looks suspiciously at 0%
@frox That's the point ;) If it wasn't using full zero-copy you'd not get 0% for the whole 3d engine.
@rmader ah right, didn't know that about radeontop.
These hardware acceleration developments are really impressive.
@rmader Nice work. Lovely to see graphics at idle.
@rmader i just read about that, and the rounded corners, interesting work :)