Speakers bio and abstracts - GStreamer Conference 2012
San Diego, USA, August 27th and August 28th, 2012
Back to conference main page
Back to conference timetable
Keynote - GStreamer 1.0, Wim Taymans, Collabora
Wim Taymans is one of the founders of the GStreamer project and the man behind the current GStreamer design. Wim has a long history in the development of multimedia software, starting with computer game development on the Commodore 64. Wim Taymans and is working on assisting Collabora customers with the design and use of GStreamer.
The GStreamer 1.0 release will be out before this years GStreamer Conference and this talk will provide a final summary of the changes and improvements GStreamer 1.0. The talk will also outline the plans for the 1.0 series going forward.
Wayland development and plans, Kristian Hoegsberg, Intel
Kristian has worked on X and Linux Graphics in general since 2004 and helped make AIGLX and DRI2 happen. Recently he’s been working on the Wayland display server. Kristian currently works at Intel, doing Linux graphics stack development.
Wayland is a new display server architecture that reuses the Linux
low-level graphics stack but makes the compositor the server and
relies exclusively on client side rendering. We're approaching the
1.0 release of Wayland, which means that we're ready to freeze the
protocol and client side API. Along with the protocol, we're
developing a reference server implementation called Weston. In the
talk we will take a look at what will be in Wayland and Weston 1.0,
with a bit of extra focus on how video and gstreamer is integrated.
Video4Linux: Current Status and Future Work, Hans Verkuil, Cisco
Hans Verkuil started contributing patches to the MPEG encoder/decoder ivtv driver
in early 2004 and it snowballed from there. Since 2008 he works on a new video4linux
core framework with the goal of fully supporting complex embedded video hardware. He
lives in Oslo, Norway, working as a senior R&D software engineer at Cisco Systems Norway,
developing both Linux and NIOS-based drivers. He gave V4L presentations before during
Embedded Linux Conferences in the US and Europe, the Plumbers Conference and LinuxCon
Video4Linux is a fast-changing subsystem where a lot of work is done to support
the complex video hardware of embedded systems. This presentation will give an
overview of recent developments and the work that is planned for the near future,
in particular the ongoing effort to support zero-copy video pipelines.
GStreamer for advanced image capture and analysis - Stephen Burks, U.S Army
Stephen Burks is the team leader of the Advanced Sensor Evaluation Facility (ASEF) at the U.S. Army Night Vision and Electronic Sensors Directorate, Fort Belvoir, VA. His research interests include novel thermal imaging systems, image fusion, and thermal sensor performance model development. He is interested in GStreamer as a means to streamline video collection with an ever expanding set of hardware requirements.
At NVESD we work with imaging sensors and often have a need to capture, process, analyze, and transmit information from them. We have found that GStreamer is well suited for solving many of our requirements. These include capturing uncompressed video from sources such as Camera Link frame grabbers, tagging frames with highly accurate timestamps, and associating frames with other metadata such as sensor readings and GPS/IMU data. We are also working on the use of the Material Exchange Format (MXF) for storing uncompressed video along with metadata with the goal of standardization by the Motion Imagery Standards Board (MISB). As part of this effort we are implementing support for SMPTE 336M KLV metadata in pipelines. Stephen Burks will discuss our motivations and approach.
Development of hardware-based Elements for GStreamer 1.0: A case study, Victor Jaquez, Igalia
Víctor worked for TI, in Mexico, in the development of GStreamer elements for the OMAP3 processors. At Igalia he has been involved in several projects for OMAP3 and OMAP4 processors.
GStreamer 1.0 brings new features for memory handling, particularly the
management of buffers. Now it is possible to implement elements that make use
of memory areas that are not accessed directly by CPU, such as the video
memory, continuous memory areas and so on.
The purpose of this talk is to show how we can use these new interfaces for
developing GStreamer elements, that are tightly integrated with the
hardware. In particular, we will show how we implemented a simple video sink
for the pandaboard, using the Direct Rendering Management (DRM) interface.
This element, called kmssink, uses many of the new concepts for memory
handling, added in GStreamer v1.0, such as allocators, buffer pools, and so
on. We will review these concepts and how they were used in the element.
The GStreamer SDK - Andoni Morales, Fluendo
Andoni Morales has been an active member of the Open Source community for a long time.
In 2008, he got involved with GStreamer when he had to choose a multimedia backend for LongoMatch, a free software project of his creation designed to analyze sports performance with video.
Andoni holds a master degree in Telecommunications Engineering by the Polytechnic University of Madrid and currently he is a senior multimedia engineer with Fluendo, working in the design and development of the company’s multimedia solutions, as well as the development of the GStreamer SDK.
Prior to joining Fluendo, Andoni worked as a software engineer at Flumotion, developing and maintaining the company’s streaming platform.
On February 2012, Fluendo and Collabora announced a partnership to
create a Software Development Kit for GStreamer, with the objective of
providing a tested and stable version of GStreamer, with a full
development environment to build GStreamer applications in the 3 most
important operating systems: Linux, Mac OS X and Windows.
The main goal of this SDK is to break the walls of GStreamer's
development in platforms like OS X and Windows, where building and
deploying GStreamer wasn't straightforward, providing native installer
packages with precompiled binaries, development files and integration
with IDE's like Visual Studio and XCode as well as a complete
documentation with tutorials and instructions to use the SDK in all
In this talk I will present the decisions made to create the GStreamer
SDK for all the target platforms, such as the GStreamer components
selected for the first version of the SDK, the GUI toolkits included
to develop graphical applications, the way we achieved modularization
and versioning of the SDK and the packaging tools used to distribute
I will also present cerbero, the multi-platform build system created
to build and package the SDK, showing how it can be used to compile
GStreamer and other projects for different platforms, architectures
and distributions. I will finish talking about the several problems
encountered while developing the SDK in all the platforms and
architectures, trying to show the hard process of getting a
cross-platform distribution of GStreamer and why this SDK was needed
to make our loved GStreamer the best option for cross-platform
CPU, Memory, Latency: Profiling and Optimizing GStreamer - Edward Hervey, Collabora
Edward Hervey has been contributing to FOSS projects, and the
GStreamer multimedia framework in particular, since 2003 when he
initiated the PiTiVi video editor project. Since then, he has become a
core contributor to GStreamer and contributes mainly to extending it
to new use-cases, improving its performance and integration on
numerous platforms and systems. Hervey has been giving presentations
on those multiple usages of GStreamer since 2005. Hervey is a Senior
Multimedia Architect at Collabora where he helps clients and
decision-makers into making the most of the GStreamer framework and
other FOSS technologies Collabora creates and maintains.
While GStreamer already achieves very good performance on various
platforms, architectures and use-cases, there is still room for
improvement. What satisfies one use-case might not be sufficient for
another use-case. Bottlenecks that were not noticeable on a desktop
computer becomes a show-stopper on an embedded platform. Latency that
was not impacting local file playback can make real-time communication
impossible even on a powerful machine.
During this talk Edward Hervey will first go through the various
metrics one wants to track: cpu usage, memory usage and latency being
the main ones. He will expose how they impact the various use-cases,
and how they are tied together.
The hardest part of optimization is actually identifying and
understanding where the bottleneck or issue lies. Therefore in a
second part, Hervey will go over the available methodologies and tools
one can use to profile the various metrics. This will range from those
applicable to any project, to those specific to GStreamer. The goal of
this second part is to pinpoint what our bottleneck or issues are, how
to avoid false-positives and the limitations and advantages of each
Various examples of past and current optimizations will be shown, how
they were identified and solved. This will include tools and scripts
that were created for that purpose.
While this talk is mostly aimed at developers using GStreamer, it
should also prove interesting to other developers, as well as
general public wanting to understand profiling and optimization.
GStreamer Streaming library - David Schleef, Entropy Wave
David Schleef is the founder and CEO of Entropy Wave, a San Francisco based company providing products and services that enable its customers to use open video technology such as WebM and Ogg/Theora for archival, professional editing, broadcasting, and content distribution. David has been an active member in the open source community for 15 years, working most recently on projects such as GStreamer, a cross-platform multimedia framework, the Dirac video codec, and various Xiph.org projects.
GSS is a new streaming server application that grew out of
work done by Entropy Wave. It is a custom standalone HTTP
server written in GLib-style C and based on GStreamer, Libsoup
for HTTP processing, Bootstrap for HTML user interface, and
JSON-GLib for request processing. Streaming protocols include
HTTP, RTSP, various flavors of RTMP, Icecast, HTTP Live Streaming,
and WebRTC. Primary streaming formats include WebM, Ogg/Theora/Vorbis,
Ogg/Theora/Opus, FLV, and MPEG-TS. As a library, GSS is useful
for creating any standalone HTTP server in the GLib ecosystem.
This talk will discuss GSS architecture, how to deploy GSS, and
how to modify and extend.
Current status of the Android enablement - Reynaldo Verdejo, Collabora
Reynaldo Verdejo is a 34 years old Multimedia Software Engineer for Collabora Ltd. He has been working in IT and Multimedia -related FOSS development for the last 11+ years. Having contributed to major projects like FFmpeg and MPlayer, among others, he is now working on GStreamer on mobile platforms. Reynaldo lives in Penco, Chile with his wife, Catherine and their 3 daughters.
Our GStreamer on Android port has made quite a lot of
progress since last year. So has Android itself. How have
we worked around latest platform changes? What's the
status of the NDK port. What about replacing stagefright
on Ice Cream Sandwich? What are we working on right now?
How can you help?
Idea of the talk is to present a detailed sum up of the work
made on enabling GStreamer on Android during last year.
To both sync with people working with GStreamer on
this platform and hopefully gather some community
interest and contributions.
Improving GStreamer quality - Jason Gerard DeRose, Novacut
Jason is the lead developer of the Novacut collaborative video editor. In the past he was working at Red Hat as part of the FreeIPA team. Most of Jason's career has been working with web technologies (both sever and client side), but he's had a longtime love affair with GStreamer. Worlds do collide.
Pro video requires impeccable reliability, release after release. To prevent regressions, we need a practical way to do continuous integration testing against a rather exhaustive set of real-world video files. We also need to test extensive NLE scenarios with video files from professional cameras. And to make life easy for developers, we need the feedback loop to be as fast as possible.
Novacut is building a GStreamer-based testing tool to do just this, and we're harnessing the cloud to get the compute resources needed run such tests in a sane amount of time (and also not break the bank).
GStreamer Status Report, Tim-Philipp Müller, Collabora
Tim-Philipp Müller is a GStreamer developer and maintainer. He studied in Hamburg, York and Aberystwyth before going to work for Fluendo. He co-founded Collabora Multimedia in 2007 and currently lives in Bristol, UK.
While GStreamer 1.0 looms close on the horizon a lot of development is still happening in the 0.10 branch, most of which will migrate accross to 10. Tim-Philipp Müller is the maintainer and release manager for GStreamer 0.10.x. This talk will give you a whirlwind tour of what's new and improved in and around GStreamer over the course of the last year.
The talk includes a high-level overview of all kinds of cool things we've improved and done lately, especially. from an application developer perspective. Topics will range from things like AC-3 passthrough now working, va-api support and transcoding improvements. The talk will also talk a bit about the support plans for GStreamer 0.10.x once GStreamer 1.0 has been released.
GStreamer for Large-Scale Scientific Signal Processing - Victories and
Wish-lists - Kipp Cannon, CITA
Kipp Cannon is a senior research associate at the Canadian Institute for Theoretical Astrophysics in Toronto. He received his doctorate in physics from the University of Alberta, Edmonton, in the field of early universe cosmology, and ahs worked at the University of Wisconsin-Milwaukee and then at the California Institute of Technology before moving home to Toronto where he uses GStreamer to search for waves of gravity from colliding back holes.
Gravitational waves are waves of spacetime curvature generated by the
movement of masses. They are a prediction of the general theory of
relativity, and although their existence has been inferred they have never
been directly detected. In the last decade, a world-wide network of
gravitational-wave detectors has been developed with the goal of
establishing the first direct observation of gravitational waves from the
most extreme events in the universe such as the collisions of black holes
and neutron stars. Rapid detection and localization of gravitational waves
will allow gravitational-wave detectors to be part of a larger transient
astronomy community and will provide exciting, new information about our
Gravitational-wave detection presents significant signal processing
challenges, and we have used GStreamer to address many of them. We
regularly run GStreamer applications having hundreds of processes with
thousands of threads per process spanning tens of thousands of CPU cores.
Our experience scaling GStreamer up to this level has been remarkably
painless, thanks in large part to the GStreamer community. In this talk,
we'll discuss our experiences, and present some of our own wish-list items
for future GStreamer development.
GStreamer, dmabuf, and OMAP4+ Update - Rob Clark, Texas Instruments
Rob Clark has been working in the arm embedded world for more than 10
years, and playing with linux for even longer. These days mostly
working on the graphics end of things (omapdrm, xf86-video-omap) and
more optimal integration of graphics and multimedia (dmabuf,
An update of GStreamer on TI OMAP4+ platforms. In the last year, a
new mechanism called dmabuf has been developed at the kernel/driver
level for zero copy buffer sharing between different devices (video
codecs, gpu and display, camera, etc). Compared to how things worked
2 years ago when the OMAP+GStreamer architecture was last presented,
this dmabuf based architecture allows for more commonality between x86
and various other ARM platforms, while at the same time providing
greater flexibility. And it is based on infrastructure that is part
of the upstream linux kernel rather than custom TI mechanisms. We
will cover how we've added support for this in GStreamer 0.10 and how
it fits in to GStreamer 1.0, as well as what is still missing.
Playing in the sandbox - GStreamer security - Guillaume Emont, Igalia
Guillaume Emont has been playing around on various things related to multimedia (Elisa/Moovida, Pigment, Grilo and of course GStreamer) in the Free software world for a few years and enjoys it a lot. He is now proudly part of the awesome group of hackers known as Igalia.
When he doesn't hack on software, he enjoys discussing with like-minded people around a drink or a good meal, various outdoor sports in and around sunny Barcelona, or trying to take photos from above using helium balloons, among many other things.
GStreamer is a big and successful project that implements complex
formats. We use it to read media streams that sometimes come from
The size and complexity of GStreamer and all the format implementations
it brings means that the presence of security bugs in a media playback
pipeline is not totally unlikely. An attacker could forge a stream that
would exploit such a bug so that he can execute code of his making in
the context where the exploited code was running.
A common way to alleviate this kind of issue is to run the software
handling untrusted data in a context where its privileges are very
limited, so that a successful exploit of a bug in the software would
only grant the attacker execution rights in that limited context. We
call such a context a sandbox.
I have run some experiments with setuid-sandbox, a stand-alone
version of the sandboxing system used by chrome on GNU/Linux, that shows
the feasibility of running at least part of a pipeline in a sandbox. In
this talk, I will explain this work, its limitations and discuss what
can be done to improve on it.
GStreamer and multi-room playout, Jan Schmidt, Oracle
Jan is a GStreamer maintainer and primary author of DVD playback support, among other things. In the past he worked for Fluendo and Sun Microsystems. Currently, he lives in Albury Australia, working from home for Oracle Corporation, and hacks on GStreamer as he can.
This talk will look at an implementation of a multi-room entertainment
system - allowing synchronised playback of music or movies in multiple
rooms simultaneously. Commercial implementations of such systems
(squeezebox, Sonos) can be costly - but the basic mechanism is quite
Flexible multimedia content creation apps with the GStreamer
Editing Services, Jeff Fortin & Thibault Saunier, Collabora
Jeff Fortin is a long-time user, designer and tester for the PiTiVi project. In recent times, he has taken over some development and maintainership tasks with Thibault Saunier. He spends most of his time doing community management and mentoring new contributors.
Thibault Saunier joined the PiTiVi project as a Summer of Code student in 2010 and has been hooked ever since. He now maintains PiTiVi and works on the GStreamer Editing Services.
GES is a library that allows rapid development of advanced
multi-platform audio/video editors using GStreamer. From your smartphone
to your high-end server cluster, GES is designed to be the solution to
all your needs. This presentation will give you an overview of GES, its history and goals.
It will also feature a case stufy of the Pitivi video editor, a major GES user, a general technical overview and how GES concepts match
well-established non-linear editing paradigms.
The talk will also cover the current features (why you want to use GES) and the roadmap ahead for the library.
ALSA project status update - Takashi Iwai, Suse
Takashi Iwai currently works as a member of hardware-enablement team in SUSE Labs
at SUSE Linux Products GmbH in Nuremberg, Germany, while playing a
role as a gatekeeper of the Linux sound subsystem tree over years.
ALSA has been deployed as the basic lowlevel sound infrastructure, and
is still one of the most actively developed area in Linux. This talk
will cover a brief introduction of ALSA, the recent development in
both the kernel and user-space sides, and the planned new features in
GStreamer base classes – or how to make your life easier - Sebastian Dröge
Sebastian Dröge is working on GStreamer since early 2006 and nowadays is one of the main developers. He also works on other open source projects in his free time and is working for Collabora on GStreamer and related technologies since 2008. Sebastian has a master's degree in computer sciences.
GStreamer provides base class for many common element types, including
just recently added base classes for audio/video decoders and encoders.
People often ask, if it is a good idea to use a base class for this or
that problem and which base class they should use.
This talk will introduce them, explains what they're doing and when they
should be used, describes the concepts and how they are used and what
advantages of their use is. In the end some future ideas for base classes and improvements to the
existing base classes will be discussed.
Debugging GStreamer pipelines, Rene Stadler, Collabora
René is a free software and GStreamer enthusiast who joined Nokia's
Linux team in 2007. After almost four years in Helsinki, he moved back
to his hometown of Duisburg, Germany to work as a full-time contractor
with Collabora Ltd.
Introduction to the powerful logging system provided by GStreamer and
how to use it when writing plugins. How to read log output to
understand what happens in your pipelines and learn about GStreamer's
internals. I will extensively demonstrate my gst-debug-viewer UI,
which can easily handle million-line log files and boost your
The Opus Audio Codec, Timothy B. Terriberry, Xiph.org
Timothy Terriberry has been contributing to codecs produced by the Xiph.Org Foundation for just about a decade. In addition to leading the Theora project and helping maintain the other Xiph codecs, he was one of the authors of Opus and assisted in its standardization. He currently works for Mozilla, where he maintains their codec implementations and tries to solve the problem of royalty-free media formats for the web.
Opus is a new lossy audio codec, standardized at the IETF by Microsoft, Mozilla, Broadcom, and others. It can replace a large collection of existing codecs for both high-quality archival music storage and low-bitrate, interactive speech, as well as everything inbetween. This talk will cover some of the interesting technical aspects of the codec, its features, and how those features interact with various aspects of gstreamer, hopefully without starting a flamewar about container formats.
OpenGL and Mesa development - Eric Anholt, Intel
Eric Anholt started working on open source to get video games to work on
the graphics drivers in Linux and FreeBSD back in high school. He has
been a developer for Intel's Open Source Technology Center since
2006. He was a key developer of the GEM kernel graphics memory
management API, and a major contributor to the new GLSL compiler that is
pushing Mesa forward to GL 3.1 and beyond.
The Mesa project has been speeding up its development over the last few
years catching up to modern OpenGL. This talk will cover some of our
recent developments and where our plans take us over the next year.
A particular focus will be made on what impact newer OpenGL may have on
gstreamer, for GPGPU-style media decode and for hardware-assisted
Road to GStreamer Expertise, Luis de Bethencourt, Collabora
Luis de Bethencourt is a freedom-lover technocrat, and has always enjoyed programming and playing around with video, so since he discovered GStreamer years ago he's been hooked. Originally from the Canary Islands, computers felt like a door to the world, and saw in Linux the best way to open it, see how it all works, and become a part of it. He currently works for Collabora and enjoys contributing to projects like Gstreamer Editing Services, Rygel, PiTiVi, freemix or snappy.
Luis de Bethencourt will be hosting a round table with 3 GStreamer Experts: Jan Schmidt,
Sebastian Dröge, and Tim P. Müller. This personal, instead of technical, Q&A will be driven by the
audience questions to the table about their experience learning, progressing, and contributing in
GStreamer. Leading and inspiring by example the experts will talk about the help, tricks, mistakes
and bumps each one of them experienced in their road to GStreamer expertise.