GStreamer
open source multimedia framework
Home
Features
News
Annual Conference
Planet (Blogs)
Download
Applications
Security Center
Developers
Documentation
Mailing Lists
File a Bug
Bug Lists
Artwork
Follow @gstreamer on Twitter

GStreamer 1.12 Release Notes

GStreamer 1.12 is scheduled for release in early May 2017.

The GStreamer team is proud to announce a new major feature release in the stable 1.x API series of your favourite cross-platform multimedia framework!

As always, this release is again packed with new features, bug fixes and other improvements.

See https://gstreamer.freedesktop.org/releases/1.12/ for the latest version of this document.

Last updated: Thursday 20 April 2017, 11:00 UTC (log)

Introduction

The GStreamer team is proud to announce a new major feature release in the stable 1.x API series of your favourite cross-platform multimedia framework!

As always, this release is again packed with new features, bug fixes and other improvements.

Highlights

  • new msdk plugin for Intel's Media SDK for hardware-accelerated video encoding and decoding on Intel graphics hardware on Windows or Linux.

  • x264enc can now use multiple x264 library versions compiled for different bit depths at runtime, to transparently provide support for multiple bit depths.

  • videoscale and videoconvert now support multi-threaded scaling and conversion, which is particularly useful with higher resolution video.

  • h264parse will now automatically insert AU delimiters if needed when outputting byte-stream format, which improves standard compliance and is needed in particular for HLS playback on iOS/macOS.

  • rtpbin has acquired bundle support for incoming streams

Major new features and changes

Noteworthy new API

  • The video library gained support for a number of new video formats:

    • GBR_12LE, GBR_12BE, GBRA_12LE, GBRA_12BE (planar 4:4:4 RGB/RGBA, 12 bits per channel)
    • GBRA_10LE, GBRA_10BE (planar 4:4:4:4 RGBA, 10 bits per channel)
    • GBRA (planar 4:4:4:4 ARGB, 8 bits per channel)
    • I420_12BE, I420_12LE (planar 4:2:0 YUV, 12 bits per channel)
    • I422_12BE,I422_12LE (planar 4:2:2 YUV, 12 bits per channel)
    • Y444_12BE, Y444_12LE (planar 4:4:4 YUV, 12 bits per channel)
    • VYUY (another packed 4:2:2 YUV format)
  • The high-level GstPlayer API was extended with functions for taking video snapshots and enabling accurate seeking. It can optionally also use the still-experimental playbin3 element now.

New Elements

  • msdk: new plugin for Intel's Media SDK for hardware-accelerated video encoding and decoding on Intel graphics hardware on Windows or Linux. This includes an H.264 encoder/decoder (msdkh264dec, msdkh264enc), an H.265 encoder/decoder (msdkh265dec, msdkh265enc), an MJPEG encoder/encoder (msdkmjpegdec, msdkmjpegenc), an MPEG-2 video encoder (msdkmpeg2enc) and a VP8 encoder (msdkvp8enc).

  • iqa is a new Image Quality Assessment plugin based on DSSIM, similar to the old (unported) videomeasure element.

  • The faceoverlay element, which allows you to overlay SVG graphics over a detected face in a video stream, has been ported from 0.10.

  • our ffmpeg wrapper plugin now exposes/maps the ffmpeg Opus audio decoder (avdec_opus) as well as the CineForm HD / CFHD decoder (avdec_cfhd), and also a parser/writer for the IVF format (avdemux_ivf and avmux_ivf).

  • audiobuffersplit is a new element that splits raw audio buffers into equal-sized buffers

  • audiomixmatrix is a new element that mixes N:M audio channels according to a configured mix matrix.

  • The timecodewait element got renamed to avwait and can operate in different modes now.

  • The opencv video processing plugin has gained a new dewarp element that dewarps fisheye images.

  • ttml is a new plugin for parsing and rendering subtitles in Timed Text Markup Language (TTML) format. For the time being these elements will not be autoplugged during media playback however, unless the GST_TTML_AUTOPLUG=1 environment variable is set.

New element features and additions

  • x264enc can now use multiple x264 library versions compiled for different bit depths at runtime, to transparently provide support for multiple bit depths. A new configure parameter --with-x264-libraries has been added to specify additional paths to look for additional x264 libraries to load. Background is that the libx264 library is always compile for one specific bit depth and the x264enc element would simply support the depth supported by the underlying library. Now we can support multiple depths.

  • x264enc also picks up the interlacing mode automatically from the input caps now and passed interlacing/TFF information correctly to the library.

  • videoscale and videoconvert now support multi-threaded scaling and conversion, which is particularly useful with higher resolution video. This has to be enabled explicitly via the "n-threads" property.

  • videorate's new "rate" property lets you set a speed factor on the output stream

  • splitmuxsink's buffer collection and scheduling was rewritten to make processing and splitting deterministic; before it was possible for a buffer to end up in a different file chunk in different runs. splitmuxsink also gained a new "format-location-full" signal that works just like the existing "format-location" signal only that it is also passed the primary stream's first buffer as argument, so that it is possible to construct the file name based on metadata such as the buffer timestamp or any GstMeta attached to the buffer. The new "max-size-timecode" property allows for timecode-based splitting. splitmuxsink will now also automatically start a new file if the input caps change in an incompatible way.

  • fakesink has a new "drop-out-of-segment" property to not drop out-of-segment buffers, which is useful for debugging purposes.

  • identity gained a "ts-offset" property.

  • both fakesink and identity now also print what kind of metas are attached to buffers when printing buffer details via the "last-message" property used by gst-launch-1.0 -v.

  • multiqueue: made "min-interleave-time" a configurable property.

  • video nerds will be thrilled to know that videotestsrc's snow is now deterministic. videotestsrc also gained some new properties to make the ball pattern based on system time, and invert colours each second ("animation-mode", "motion", and "flip" properties).

  • oggdemux reverse playback should work again now. You're welcome.

  • playbin3 and urisourcebin now have buffering enabled by default, and buffering message aggregation was fixed.

  • tcpclientsrc now has a "timeout" property

  • appsink has gained support for buffer lists. For backwards compatibility reasons users need to enable this explicitly with gst_app_sink_set_buffer_list_support(), however. Once activated, a pulled GstSample can contain either a buffer list or a single buffer.

  • splitmuxsrc reverse playback was fixed and handling of sparse streams, such as subtitle tracks or metadata tracks, was improved.

  • updsrc can join groups on multiple multicast interfaces now.

  • matroskamux has acquired support for muxing G722 audio; it also marks all buffers as keyframes now when streaming only audio, so that tcpserversink will behave properly with audio-only streams.

  • qtmux gained support for ProRes 4444 XQ, HEVC/H.265 and CineForm formats, and generally writes more video stream-related metadata into the track headers. It is also allows configuration of the maximum interleave size in bytes and time now. For fragmented mp4 we always write the tfdt atom now as required by the DASH spec.

  • qtdemux supports FLAC, xvid, mp2 and S16L tracks now, and generally tries harder to extract more video-related information from track headers, such as colorimetry or interlacing details. It also received a couple of fixes for the scenario where upstream operates in TIME format and feeds chunks to qtdemux (e.g. DASH or MSE).

  • audioecho has two new properties to apply a delay only to certain channels to create a surround effect, rather than an echo on all channels. This is useful when upmixing from stereo, for example. The "surround-delay" property enables this, and the "surround-mask" property controls which channels are considered surround sound channels in this case.

  • webrtcdsp gained various new properties for gain control and also exposes voice activity detection now, in which case it will post "voice-activity" messages on the bus whenever the voice detection status changes.

  • The decklink capture elements for blackmagic cards have seen a number of improvements:

    • decklinkvideosrc will post a warning message on "no signal" and an info message when the signal lock has been (re)acquired. There is also a new read-only "signal" property that can be used to query the signal lock status. The GAP flag will be set on buffers that are captured without a signal lock. The new drop-no-signal-frames will make decklinkvideosrc drop all buffers that have been captured without an input signal. The "skip-first-time" property will make the source drop the first few buffers, which is handy since some devices will at first output buffers with the wrong resolution before they manage to figure out the right input format and decide on the actual output caps.

    • decklinkaudiosrc supports more than just 2 audio channels now.

    • The capture sources no longer use the "hardware" timestamps which turn out to be useless and instead just use the pipeline clock directly.

  • srtpdec now also has a readonly "stats" property, just like srtpenc.

  • rtpbin can now also demultiplex incoming bundled streams. The first rtpsession will have a rtpssrcdemux element inside splitting the streams based on their SSRC and potentially dispatch to a different rtpsession. Because retransmission SSRCs need to be merged with the corresponding media stream the ::on-bundled-ssrc signal is emitted on rtpbin so that the application can find out to which session the SSRC belongs.

  • rtprtxqueue gained two now properties exposing retransmission statistics ("requests" and "fulfilled-requests")

  • kmssink will now use the prefered mode for the monitor and render to the base plane if nothing else has set a mode yet. This can also be done forcibly in any case via the new "force-modesetting" property. Furthermore, kmssink now allows only the supported connector resolutions as input caps in order to avoid scaling or positioning of the input stream, as kmssink can't know whether scaling or positioning would be more appropriate for the use case at hand.

Plugin moves

  • dataurisrc moved from gst-plugins-bad to core

  • The rawparse plugin containing the rawaudioparse and rawvideoparse elements moved from gst-plugins-bad to gst-plugins-base. These elements supersede the old videoparse and audioparse elements. They work the same, with just some minor API changes. The old legacy elements still exist in gst-plugins-bad, but may be removed at some point in the future.

  • timecodestamper is an element that attaches time codes to video buffers in form of GstVideoTimeCodeMetas. It had a "clock-source" property which has now been removed because it was fairly useless in practice. It gained some new properties however: the "first-timecode" property can be used to set the inital timecode; alternatively "first-timecode-to-now" can be set, and then the current system time at the time the first buffer arrives is used as base time for the time codes.

Plugin removals

  • The mad mp1/mp2/mp3 decoder plugin was removed from gst-plugins-ugly, as libmad is GPL licensed, has been unmaintained for a very long time, and there are better alternatives available. Use the mpg123audiodec element from the mpg123 plugin in gst-plugins-ugly instead, or avdec_mp3 from the gst-libav module which wraps the ffmpeg library. We expect that we will be able to move mp3 decoding to gst-plugins-good in the next cycle seeing that most patents around mp3 have expired recently or are about to expire.

  • The mimic plugin was removed from gst-plugins-bad. It contained a decoder and encoder for a video codec used by MSN messanger many many years ago (in a galaxy far far away). The underlying library is unmaintained and no one really needs to use this codec any more. Recorded videos can still be played back with the MIMIC decoder in gst-libav.

Miscellaneous API additions

  • Request pad name templates passed to gst_element_request_pad() may now contain multiple specifiers, such as e.g. src_%u_%u.

  • gst_buffer_iterate_meta_filtered() is a variant of gst_buffer_iterate_meta() that only returns metas of the requested type and skips all other metas.

  • gst_pad_task_get_state() gets the current state of a task in a thread-safe way.

  • gst_uri_get_media_fragment_table() provides the media fragments of an URI as a table of key=value pairs.

  • gst_print(), gst_println(), gst_printerr(), and gst_printerrln() can be used to print to stdout or stderr. These functions are similar to g_print() and g_printerr() but they also support all the additional format specifiers provided by the GStreamer logging system, such as e.g. GST_PTR_FORMAT.

  • a GstParamSpecArray has been added, for elements who want to have array type properties, such as the audiomixmatrix element for example. There are also two new functions to set and get properties of this type from bindings:

    • gst_util_set_object_array()
    • gst_util_get_object_array()
  • various helper functions have been added to make it easier to set or get GstStructure fields containing caps-style array or list fields from language bindings (which usually support GValueArray but don't know about the GStreamer specific fundamental types):

  • a new 'dynamic type' registry factory type was added to register dynamically loadable GType types. This is useful for automatically loading enum/flags types that are used in caps, such as for example the GstVideoMultiviewFlagsSet type used in multiview video caps.

  • there is a new GstProxyControlBinding for use with GstController. This allows proxying the control interface from one property on one GstObject to another property (of the same type) in another GstObject. So e.g. in parent-child relationship, one may need to call gst_object_sync_values() on the child and have a binding (set elsewhere) on the parent update the value. This is used in glvideomixer and glsinkbin for example, where sync_values() on the child pad or element will call sync_values() on the exposed bin pad or element.

    Note that this doesn't solve GObject property forwarding, that must be taken care of by the implementation manually or using GBinding.

  • gst_base_parse_drain() has been made public for subclasses to use.

  • `gst_base_sink_set_drop_out_of_segment()' can be used by subclasses to prevent GstBaseSink from dropping buffers that fall outside of the segment.

  • gst_calculate_linear_regression() is a new utility function to calculate a linear regression.

  • gst_debug_get_stack_trace is an easy way to retrieve a stack trace, which can be useful in tracer plugins.

  • allocators: the dmabuf allocator is now sub-classable, and there is a new GST_CAPS_FEATURE_MEMORY_DMABUF define.

  • video decoder subclasses can use the newly-added function gst_video_decoder_allocate_output_frame_with_params() to pass a GstBufferPoolAcquireParams to the buffer pool for each buffer allocation.

  • the video time code API has gained a dedicated GstVideoTimeCodeInterval type plus related API, including functions to add intervals to timecodes.

  • There is a new libgstbadallocators-1.0 library in gst-plugins-bad, which may go away again in future releases once the GstPhysMemoryAllocator interface API has been validated by more users.

GstPlayer

New API has been added to:

  • get the number of audio/video/subtitle streams:

    • gst_player_media_info_get_number_of_streams()
    • gst_player_media_info_get_number_of_video_streams()
    • gst_player_media_info_get_number_of_audio_streams()
    • gst_player_media_info_get_number_of_subtitle_streams()
  • enable accurate seeking: gst_player_config_set_seek_accurate() and gst_player_config_get_seek_accurate()

  • get a snapshot image of the video in RGBx, BGRx, JPEG, PNG or native format: gst_player_get_video_snapshot()

  • selecting use of a specific video sink element (gst_player_video_overlay_video_renderer_new_with_sink())

If the environment variable GST_PLAYER_USE_PLAYBIN3 is set, GstPlayer will use the still-experimental playbin3 element and the GstStreams API for playback.

Miscellaneous changes

  • video caps for interlaced video may contain an optional "field-order" field now in the case of interlaced-mode=interleaved to signal that the field order is always the same throughout the stream. This is useful to signal to muxers such as mp4mux. The new field is parsed from/to GstVideoInfo of course.

  • video decoder and video encoder base classes try harder to proxy interlacing-related fields in caps properly.

  • The buffer stored in the PROTECTION events is now left unchanged. This is a change of behaviour since 1.8, especially for the mssdemux element which used to decode the base64 parsed data wrapped in the protection events emitted by the demuxer.

  • PROTECTION events can now be injected into the pipeline from the application; source elements deriving from GstBaseSrc will forward those downstream now.

  • The DASH demuxer is now correctly parsing the MSPR-2.0 ContentProtection nodes and emits Protection events accordingly. Applications relying on those events might need to decode the base64 data stored in the event buffer before using it.

  • The registry can now also be disabled by setting the environment variable GST_REGISTRY_DISABLE=yes, with similar effect as the GST_DISABLE_REGISTRY compile time switch.

  • Seeking performance with gstreamer-vaapi based decoders was improved. It would recreate the decoder and surfaces on every seek which can be quite slow.

  • more robust handling of input caps changes in videoaggregator-based elements such as compositor.

  • Lots of adaptive streaming-related fixes across the board. Also:

    • mssdemux, the Microsoft Smooth Streaming demuxer, has seen various fixes for live streams, duration reporting and seeking.

    • The DASH manifest parser now extracts MS PlayReady ContentProtection objects from manifests and sends them downstream as PROTECTION events. It also supports multiple Period elements in external xml now.

  • gst-libav was updated to ffmpeg 3.3 but should still work with any 3.x version.

OpenGL integration

  • As usual the GStreamer OpenGL integration library has seen numerous fixes and performance improvements all over the place.

  • The GStreamer OpenGL integration layer has also gained support for the Vivante EGL FB windowing system, which improves performance on platforms such as Freescale iMX.6 for those who are stuck with the proprietary driver. The qmlglsink element also supports this now if Qt is used with eglfs or wayland backend, and it works in conjunction with gstreamer-imx of course.

  • various qmlglsrc improvements

Tracing framework and debugging improvements

  • New tracing hooks have been added to track GstMiniObject and GstObject ref/unref operations.

  • The memory leaks tracer can optionally use this to retrieve stack traces if enabled with e.g. GST_TRACERS=leaks(filters="GstEvent,GstMessage",stack-traces-flags=full)

  • The GST_DEBUG_FILE environment variable, which can be used to write the debug log output to a file instead of printing it to stderr, can now contain a name pattern, which is useful for automated testing and continuous integration systems. The following format specifiers are supported:

    • %p: will be replaced with the PID
    • %r: will be replaced with a random number, which is useful for instance when running two processes with the same PID but in different containers.

Tools

  • gst-inspect-1.0 can now list elements by type with the new --types command-line option, e.g. gst-inspect-1.0 --types=Audio/Encoder will show a list of audio encoders.

  • gst-launch-1.0 and gst_parse_launch() have gained a new operator (:) that allows linking all pads between two elements. This is useful in cases where the exact number of pads or type of pads is not known beforehand, such as in the uridecodebin : encodebin scenario, for example. In this case, multiple links will be created if the encodebin has multiple profiles compatible with the output of uridecodebin.

  • gst-device-monitor-1.0 now shows a gst-launch-1.0 snippet for each device that shows how to make use of it in a gst-launch-1.0 pipeline string.

GStreamer RTSP server

  • The RTSP server now also supports Digest authentication.

  • The GstRTSPClient class has gained a pre-*-request signal and virtual method for each client request type, emitted in the beginning of each rtsp request. These signals or virtual methods let the application validate the requests, configure the media/stream in a certain way and also generate error status codes in case of an error or a bad request.

GStreamer VAAPI

  • GstVaapiDisplay now inherits from GstObject, thus the VA display logging messages are better and tracing the context sharing is more readable.

  • When uploading raw images into a VA surfaces now VADeriveImages are tried fist, improving the upload performance, if it is possible.

  • The decoders and the post-processor now can push dmabuf-based buffers to downstream under certain conditions. For example:

    GST_GL_PLATFORM=egl gst-play-1.0 video-sample.mkv --videosink=glimagesink

  • Refactored the wrapping of VA surface into gstreamer memory, adding lock when mapping and unmapping, and many other fixes.

  • Now vaapidecodebin loads vaapipostproc dynamically. It is possible to avoid it usage with the environment variable GST_VAAPI_DISABLE_VPP=1.

  • Regarding encoders: they have primary rank again, since they can discover, in run-time, the color formats they can use for upstream raw buffers and caps renegotiation is now possible. Also the encoders push encoding info downstream via tags.

  • About specific encoders: added constant bit-rate encoding mode for VP8 and H265 encoder handles P010_10LE color format.

  • Regarding decoders, flush operation has been improved, now the internal VA encoder is not recreated at each flush. Also there are several improvements in the handling of H264 and H265 streams.

  • VAAPI plugins try to create their on GstGL context (when available) if they cannot find it in the pipeline, to figure out what type of VA Display they should create.

  • Regarding vaapisink for X11, if the backend reports that it is unable to render correctly the current color format, an internal VA post-processor, is instantiated (if available) and converts the color format.

Build and Dependencies

  • Meson build files are now disted in tarballs, for jhbuild and so distro packagers can start using it.

  • Some plugin filenames have been changed to match the plugin names: for example the file name of the encoding plugin in gst-plugins-base containing the encodebin element was libgstencodebin.so and has been changed to libgstencodebin.so. This affects only a handful of plugins across modules.

    Developers who install GStreamer from source and just do make install after updating the source code, without doing make uninstall first, will have to manually remove the old installed plugin files from the installation prefix, or they will get 'Cannot register existing type' critical warnings.

  • Most of the docbook-based documentation (FAQ, Application Development Manual, Plugin Writer's Guide, design documents) has been converted to markdown and moved into a new gst-docs module. The gtk-doc library API references and the plugins documentation are still built as part of the source modules though.

  • GStreamer core now optionally uses libunwind and libdw to generate backtraces. This is useful for tracer plugins used during debugging and development.

  • There is a new libgstbadallocators-1.0 library in gst-plugins-bad (which may go away again in future releases once the GstPhysMemoryAllocator interface API has been validated by more users).

  • gst-omx and gstreamer-vaapi modules can now also be built using the Meson build system.

Platform-specific improvements

Android

  • androidmedia: add support for VP9 video decoding/encoding and Opus audio decoding (where supported)

OS/X and iOS

  • avfvideosrc, which represents an iphone camera or, on mac, a screencapture session, so far allowed you to select an input device by device index only. New API adds the ability to select the position (front or back facing) and device-type (wide angle, telephoto, etc.). Furthermore, you can now also specify the orientation (portrait, landscape, etc.) of the videostream.

Windows

  • dx9screencapsrc can now optionally also capture the cursor.

Contributors

  • FILL ME

... and many others who have contributed bug reports, translations, sent suggestions or helped testing.

Bugs fixed in 1.12

More than ~600 bugs have been fixed during the development of 1.12.

This list does not include issues that have been cherry-picked into the stable 1.10 branch and fixed there as well, all fixes that ended up in the 1.10 branch are also included in 1.12.

This list also does not include issues that have been fixed without a bug report in bugzilla, so the actual number of fixes is much higher.

Stable 1.12 branch

After the 1.12.0 release there will be several 1.12.x bug-fix releases which will contain bug fixes which have been deemed suitable for a stable branch, but no new features or intrusive changes will be added to a bug-fix release usually. The 1.12.x bug-fix releases will be made from the git 1.12 branch, which is a stable branch.

1.12.0

1.12.0 was released on TBD May 2017.

Known Issues

  • The webrtcdsp element is currently not shipped as part of the Windows binary packages due to a build system issue.

Schedule for 1.14

Our next major feature release will be 1.14, and 1.11 will be the unstable development version leading up to the stable 1.12 release. The development of 1.13/1.14 will happen in the git master branch.

The plan for the 1.14 development cycle is yet to be confirmed, but it is expected that feature freeze will be around September 2017 followed by several 1.13 pre-releases and the new 1.14 stable release in October.

1.14 will be backwards-compatible to the stable 1.12, 1.10, 1.8, 1.6, 1.4, 1.2 and 1.0 release series.


These release notes have been prepared by Sebastian Dröge, Tim-Philipp Müller and Víctor Manuel Jáquez Leal.

License: CC BY-SA 4.0


Report a problem on this page.