open source multimedia framework
Annual Conference
Planet (Blogs)
Mailing Lists
File a Bug
Bug Lists
Follow @gstreamer on Twitter

Speakers bio and abstracts - GStreamer Conference 2012

San Diego, USA, August 27th and August 28th, 2012

Back to conference main page

Back to conference timetable

Keynote - GStreamer 1.0, Wim Taymans, Collabora

Wim Taymans is one of the founders of the GStreamer project and the man behind the current GStreamer design. Wim has a long history in the development of multimedia software, starting with computer game development on the Commodore 64. Wim Taymans and is working on assisting Collabora customers with the design and use of GStreamer.

Talk Abstract

The GStreamer 1.0 release will be out before this years GStreamer Conference and this talk will provide a final summary of the changes and improvements GStreamer 1.0. The talk will also outline the plans for the 1.0 series going forward.

Wayland development and plans, Kristian Hoegsberg, Intel

Kristian has worked on X and Linux Graphics in general since 2004 and helped make AIGLX and DRI2 happen. Recently he’s been working on the Wayland display server. Kristian currently works at Intel, doing Linux graphics stack development.

Talk Abstract

Wayland is a new display server architecture that reuses the Linux low-level graphics stack but makes the compositor the server and relies exclusively on client side rendering. We're approaching the 1.0 release of Wayland, which means that we're ready to freeze the protocol and client side API. Along with the protocol, we're developing a reference server implementation called Weston. In the talk we will take a look at what will be in Wayland and Weston 1.0, with a bit of extra focus on how video and gstreamer is integrated.

Video4Linux: Current Status and Future Work, Hans Verkuil, Cisco

Hans Verkuil started contributing patches to the MPEG encoder/decoder ivtv driver in early 2004 and it snowballed from there. Since 2008 he works on a new video4linux core framework with the goal of fully supporting complex embedded video hardware. He lives in Oslo, Norway, working as a senior R&D software engineer at Cisco Systems Norway, developing both Linux and NIOS-based drivers. He gave V4L presentations before during Embedded Linux Conferences in the US and Europe, the Plumbers Conference and LinuxCon in Japan.

Talk Abstract

Video4Linux is a fast-changing subsystem where a lot of work is done to support the complex video hardware of embedded systems. This presentation will give an overview of recent developments and the work that is planned for the near future, in particular the ongoing effort to support zero-copy video pipelines.

GStreamer for advanced image capture and analysis - Stephen Burks, U.S Army

Stephen Burks is the team leader of the Advanced Sensor Evaluation Facility (ASEF) at the U.S. Army Night Vision and Electronic Sensors Directorate, Fort Belvoir, VA. His research interests include novel thermal imaging systems, image fusion, and thermal sensor performance model development. He is interested in GStreamer as a means to streamline video collection with an ever expanding set of hardware requirements.

Talk Abstract

At NVESD we work with imaging sensors and often have a need to capture, process, analyze, and transmit information from them. We have found that GStreamer is well suited for solving many of our requirements. These include capturing uncompressed video from sources such as Camera Link frame grabbers, tagging frames with highly accurate timestamps, and associating frames with other metadata such as sensor readings and GPS/IMU data. We are also working on the use of the Material Exchange Format (MXF) for storing uncompressed video along with metadata with the goal of standardization by the Motion Imagery Standards Board (MISB). As part of this effort we are implementing support for SMPTE 336M KLV metadata in pipelines. Stephen Burks will discuss our motivations and approach.

Development of hardware-based Elements for GStreamer 1.0: A case study, Victor Jaquez, Igalia

Víctor worked for TI, in Mexico, in the development of GStreamer elements for the OMAP3 processors. At Igalia he has been involved in several projects for OMAP3 and OMAP4 processors.

Talk Abstract

GStreamer 1.0 brings new features for memory handling, particularly the management of buffers. Now it is possible to implement elements that make use of memory areas that are not accessed directly by CPU, such as the video memory, continuous memory areas and so on.

The purpose of this talk is to show how we can use these new interfaces for developing GStreamer elements, that are tightly integrated with the hardware. In particular, we will show how we implemented a simple video sink for the pandaboard, using the Direct Rendering Management (DRM) interface.

This element, called kmssink, uses many of the new concepts for memory handling, added in GStreamer v1.0, such as allocators, buffer pools, and so on. We will review these concepts and how they were used in the element.

The GStreamer SDK - Andoni Morales, Fluendo

Andoni Morales has been an active member of the Open Source community for a long time. In 2008, he got involved with GStreamer when he had to choose a multimedia backend for LongoMatch, a free software project of his creation designed to analyze sports performance with video. Andoni holds a master degree in Telecommunications Engineering by the Polytechnic University of Madrid and currently he is a senior multimedia engineer with Fluendo, working in the design and development of the company’s multimedia solutions, as well as the development of the GStreamer SDK.

Prior to joining Fluendo, Andoni worked as a software engineer at Flumotion, developing and maintaining the company’s streaming platform.

Talk Abstract

On February 2012, Fluendo and Collabora announced a partnership to create a Software Development Kit for GStreamer, with the objective of providing a tested and stable version of GStreamer, with a full development environment to build GStreamer applications in the 3 most important operating systems: Linux, Mac OS X and Windows.

The main goal of this SDK is to break the walls of GStreamer's development in platforms like OS X and Windows, where building and deploying GStreamer wasn't straightforward, providing native installer packages with precompiled binaries, development files and integration with IDE's like Visual Studio and XCode as well as a complete documentation with tutorials and instructions to use the SDK in all the platforms.

In this talk I will present the decisions made to create the GStreamer SDK for all the target platforms, such as the GStreamer components selected for the first version of the SDK, the GUI toolkits included to develop graphical applications, the way we achieved modularization and versioning of the SDK and the packaging tools used to distribute it.

I will also present cerbero, the multi-platform build system created to build and package the SDK, showing how it can be used to compile GStreamer and other projects for different platforms, architectures and distributions. I will finish talking about the several problems encountered while developing the SDK in all the platforms and architectures, trying to show the hard process of getting a cross-platform distribution of GStreamer and why this SDK was needed to make our loved GStreamer the best option for cross-platform multimedia development!

CPU, Memory, Latency: Profiling and Optimizing GStreamer - Edward Hervey, Collabora

Edward Hervey has been contributing to FOSS projects, and the GStreamer multimedia framework in particular, since 2003 when he initiated the PiTiVi video editor project. Since then, he has become a core contributor to GStreamer and contributes mainly to extending it to new use-cases, improving its performance and integration on numerous platforms and systems. Hervey has been giving presentations on those multiple usages of GStreamer since 2005. Hervey is a Senior Multimedia Architect at Collabora where he helps clients and decision-makers into making the most of the GStreamer framework and other FOSS technologies Collabora creates and maintains.

Talk Abstract

While GStreamer already achieves very good performance on various platforms, architectures and use-cases, there is still room for improvement. What satisfies one use-case might not be sufficient for another use-case. Bottlenecks that were not noticeable on a desktop computer becomes a show-stopper on an embedded platform. Latency that was not impacting local file playback can make real-time communication impossible even on a powerful machine.

During this talk Edward Hervey will first go through the various metrics one wants to track: cpu usage, memory usage and latency being the main ones. He will expose how they impact the various use-cases, and how they are tied together.

The hardest part of optimization is actually identifying and understanding where the bottleneck or issue lies. Therefore in a second part, Hervey will go over the available methodologies and tools one can use to profile the various metrics. This will range from those applicable to any project, to those specific to GStreamer. The goal of this second part is to pinpoint what our bottleneck or issues are, how to avoid false-positives and the limitations and advantages of each profiling technique.

Various examples of past and current optimizations will be shown, how they were identified and solved. This will include tools and scripts that were created for that purpose.

While this talk is mostly aimed at developers using GStreamer, it should also prove interesting to other developers, as well as general public wanting to understand profiling and optimization.

GStreamer Streaming library - David Schleef, Entropy Wave

David Schleef is the founder and CEO of Entropy Wave, a San Francisco based company providing products and services that enable its customers to use open video technology such as WebM and Ogg/Theora for archival, professional editing, broadcasting, and content distribution. David has been an active member in the open source community for 15 years, working most recently on projects such as GStreamer, a cross-platform multimedia framework, the Dirac video codec, and various projects.

Talk Abstract

GSS is a new streaming server application that grew out of work done by Entropy Wave. It is a custom standalone HTTP server written in GLib-style C and based on GStreamer, Libsoup for HTTP processing, Bootstrap for HTML user interface, and JSON-GLib for request processing. Streaming protocols include HTTP, RTSP, various flavors of RTMP, Icecast, HTTP Live Streaming, and WebRTC. Primary streaming formats include WebM, Ogg/Theora/Vorbis, Ogg/Theora/Opus, FLV, and MPEG-TS. As a library, GSS is useful for creating any standalone HTTP server in the GLib ecosystem. This talk will discuss GSS architecture, how to deploy GSS, and how to modify and extend.

Current status of the Android enablement - Reynaldo Verdejo, Collabora

Reynaldo Verdejo is a 34 years old Multimedia Software Engineer for Collabora Ltd. He has been working in IT and Multimedia -related FOSS development for the last 11+ years. Having contributed to major projects like FFmpeg and MPlayer, among others, he is now working on GStreamer on mobile platforms. Reynaldo lives in Penco, Chile with his wife, Catherine and their 3 daughters.

Talk Abstract

Our GStreamer on Android port has made quite a lot of progress since last year. So has Android itself. How have we worked around latest platform changes? What's the status of the NDK port. What about replacing stagefright on Ice Cream Sandwich? What are we working on right now? How can you help?

Idea of the talk is to present a detailed sum up of the work made on enabling GStreamer on Android during last year. To both sync with people working with GStreamer on this platform and hopefully gather some community interest and contributions.

Improving GStreamer quality - Jason Gerard DeRose, Novacut

Jason is the lead developer of the Novacut collaborative video editor. In the past he was working at Red Hat as part of the FreeIPA team. Most of Jason's career has been working with web technologies (both sever and client side), but he's had a longtime love affair with GStreamer. Worlds do collide.

Talk Abstract

Pro video requires impeccable reliability, release after release. To prevent regressions, we need a practical way to do continuous integration testing against a rather exhaustive set of real-world video files. We also need to test extensive NLE scenarios with video files from professional cameras. And to make life easy for developers, we need the feedback loop to be as fast as possible.

Novacut is building a GStreamer-based testing tool to do just this, and we're harnessing the cloud to get the compute resources needed run such tests in a sane amount of time (and also not break the bank).

GStreamer Status Report, Tim-Philipp Müller, Collabora

Tim-Philipp Müller is a GStreamer developer and maintainer. He studied in Hamburg, York and Aberystwyth before going to work for Fluendo. He co-founded Collabora Multimedia in 2007 and currently lives in Bristol, UK.

Talk Abstract

While GStreamer 1.0 looms close on the horizon a lot of development is still happening in the 0.10 branch, most of which will migrate accross to 10. Tim-Philipp Müller is the maintainer and release manager for GStreamer 0.10.x. This talk will give you a whirlwind tour of what's new and improved in and around GStreamer over the course of the last year.

The talk includes a high-level overview of all kinds of cool things we've improved and done lately, especially. from an application developer perspective. Topics will range from things like AC-3 passthrough now working, va-api support and transcoding improvements. The talk will also talk a bit about the support plans for GStreamer 0.10.x once GStreamer 1.0 has been released.

GStreamer for Large-Scale Scientific Signal Processing - Victories and Wish-lists - Kipp Cannon, CITA

Kipp Cannon is a senior research associate at the Canadian Institute for Theoretical Astrophysics in Toronto. He received his doctorate in physics from the University of Alberta, Edmonton, in the field of early universe cosmology, and ahs worked at the University of Wisconsin-Milwaukee and then at the California Institute of Technology before moving home to Toronto where he uses GStreamer to search for waves of gravity from colliding back holes.

Talk Abstract

Gravitational waves are waves of spacetime curvature generated by the movement of masses. They are a prediction of the general theory of relativity, and although their existence has been inferred they have never been directly detected. In the last decade, a world-wide network of gravitational-wave detectors has been developed with the goal of establishing the first direct observation of gravitational waves from the most extreme events in the universe such as the collisions of black holes and neutron stars. Rapid detection and localization of gravitational waves will allow gravitational-wave detectors to be part of a larger transient astronomy community and will provide exciting, new information about our Universe.

Gravitational-wave detection presents significant signal processing challenges, and we have used GStreamer to address many of them. We regularly run GStreamer applications having hundreds of processes with thousands of threads per process spanning tens of thousands of CPU cores. Our experience scaling GStreamer up to this level has been remarkably painless, thanks in large part to the GStreamer community. In this talk, we'll discuss our experiences, and present some of our own wish-list items for future GStreamer development.

GStreamer, dmabuf, and OMAP4+ Update - Rob Clark, Texas Instruments

Rob Clark has been working in the arm embedded world for more than 10 years, and playing with linux for even longer. These days mostly working on the graphics end of things (omapdrm, xf86-video-omap) and more optimal integration of graphics and multimedia (dmabuf, dri2video).

Talk Abstract

An update of GStreamer on TI OMAP4+ platforms. In the last year, a new mechanism called dmabuf has been developed at the kernel/driver level for zero copy buffer sharing between different devices (video codecs, gpu and display, camera, etc). Compared to how things worked 2 years ago when the OMAP+GStreamer architecture was last presented, this dmabuf based architecture allows for more commonality between x86 and various other ARM platforms, while at the same time providing greater flexibility. And it is based on infrastructure that is part of the upstream linux kernel rather than custom TI mechanisms. We will cover how we've added support for this in GStreamer 0.10 and how it fits in to GStreamer 1.0, as well as what is still missing.

Playing in the sandbox - GStreamer security - Guillaume Emont, Igalia

Guillaume Emont has been playing around on various things related to multimedia (Elisa/Moovida, Pigment, Grilo and of course GStreamer) in the Free software world for a few years and enjoys it a lot. He is now proudly part of the awesome group of hackers known as Igalia.

When he doesn't hack on software, he enjoys discussing with like-minded people around a drink or a good meal, various outdoor sports in and around sunny Barcelona, or trying to take photos from above using helium balloons, among many other things.

Talk Abstract

GStreamer is a big and successful project that implements complex formats. We use it to read media streams that sometimes come from untrusted sources.

The size and complexity of GStreamer and all the format implementations it brings means that the presence of security bugs in a media playback pipeline is not totally unlikely. An attacker could forge a stream that would exploit such a bug so that he can execute code of his making in the context where the exploited code was running.

A common way to alleviate this kind of issue is to run the software handling untrusted data in a context where its privileges are very limited, so that a successful exploit of a bug in the software would only grant the attacker execution rights in that limited context. We call such a context a sandbox.

I have run some experiments[1] with setuid-sandbox[2], a stand-alone version of the sandboxing system used by chrome on GNU/Linux, that shows the feasibility of running at least part of a pipeline in a sandbox. In this talk, I will explain this work[3], its limitations and discuss what can be done to improve on it.

GStreamer and multi-room playout, Jan Schmidt, Oracle

Jan is a GStreamer maintainer and primary author of DVD playback support, among other things. In the past he worked for Fluendo and Sun Microsystems. Currently, he lives in Albury Australia, working from home for Oracle Corporation, and hacks on GStreamer as he can.

Talk Abstract

This talk will look at an implementation of a multi-room entertainment system - allowing synchronised playback of music or movies in multiple rooms simultaneously. Commercial implementations of such systems (squeezebox, Sonos) can be costly - but the basic mechanism is quite simple.

Flexible multimedia content creation apps with the GStreamer Editing Services, Jeff Fortin & Thibault Saunier, Collabora

Jeff Fortin is a long-time user, designer and tester for the PiTiVi project. In recent times, he has taken over some development and maintainership tasks with Thibault Saunier. He spends most of his time doing community management and mentoring new contributors.

Thibault Saunier joined the PiTiVi project as a Summer of Code student in 2010 and has been hooked ever since. He now maintains PiTiVi and works on the GStreamer Editing Services.

Talk Abstract

GES is a library that allows rapid development of advanced multi-platform audio/video editors using GStreamer. From your smartphone to your high-end server cluster, GES is designed to be the solution to all your needs. This presentation will give you an overview of GES, its history and goals. It will also feature a case stufy of the Pitivi video editor, a major GES user, a general technical overview and how GES concepts match well-established non-linear editing paradigms.

The talk will also cover the current features (why you want to use GES) and the roadmap ahead for the library.

ALSA project status update - Takashi Iwai, Suse

Takashi Iwai currently works as a member of hardware-enablement team in SUSE Labs at SUSE Linux Products GmbH in Nuremberg, Germany, while playing a role as a gatekeeper of the Linux sound subsystem tree over years.

Talk Abstract

ALSA has been deployed as the basic lowlevel sound infrastructure, and is still one of the most actively developed area in Linux. This talk will cover a brief introduction of ALSA, the recent development in both the kernel and user-space sides, and the planned new features in near future.

GStreamer base classes – or how to make your life easier - Sebastian Dröge

Sebastian Dröge is working on GStreamer since early 2006 and nowadays is one of the main developers. He also works on other open source projects in his free time and is working for Collabora on GStreamer and related technologies since 2008. Sebastian has a master's degree in computer sciences.

Talk Abstract

GStreamer provides base class for many common element types, including just recently added base classes for audio/video decoders and encoders. People often ask, if it is a good idea to use a base class for this or that problem and which base class they should use. This talk will introduce them, explains what they're doing and when they should be used, describes the concepts and how they are used and what advantages of their use is. In the end some future ideas for base classes and improvements to the existing base classes will be discussed.

Debugging GStreamer pipelines, Rene Stadler, Collabora

René is a free software and GStreamer enthusiast who joined Nokia's Linux team in 2007. After almost four years in Helsinki, he moved back to his hometown of Duisburg, Germany to work as a full-time contractor with Collabora Ltd.

Talk Abstract

Introduction to the powerful logging system provided by GStreamer and how to use it when writing plugins. How to read log output to understand what happens in your pipelines and learn about GStreamer's internals. I will extensively demonstrate my gst-debug-viewer UI, which can easily handle million-line log files and boost your productivity.

The Opus Audio Codec, Timothy B. Terriberry,

Timothy Terriberry has been contributing to codecs produced by the Xiph.Org Foundation for just about a decade. In addition to leading the Theora project and helping maintain the other Xiph codecs, he was one of the authors of Opus and assisted in its standardization. He currently works for Mozilla, where he maintains their codec implementations and tries to solve the problem of royalty-free media formats for the web.

Talk Abstract

Opus is a new lossy audio codec, standardized at the IETF by Microsoft, Mozilla, Broadcom, and others. It can replace a large collection of existing codecs for both high-quality archival music storage and low-bitrate, interactive speech, as well as everything inbetween. This talk will cover some of the interesting technical aspects of the codec, its features, and how those features interact with various aspects of gstreamer, hopefully without starting a flamewar about container formats.

OpenGL and Mesa development - Eric Anholt, Intel

Eric Anholt started working on open source to get video games to work on the graphics drivers in Linux and FreeBSD back in high school. He has been a developer for Intel's Open Source Technology Center since 2006. He was a key developer of the GEM kernel graphics memory management API, and a major contributor to the new GLSL compiler that is pushing Mesa forward to GL 3.1 and beyond.

Talk Abstract

The Mesa project has been speeding up its development over the last few years catching up to modern OpenGL. This talk will cover some of our recent developments and where our plans take us over the next year. A particular focus will be made on what impact newer OpenGL may have on gstreamer, for GPGPU-style media decode and for hardware-assisted post-processing.

Road to GStreamer Expertise, Luis de Bethencourt, Collabora

Luis de Bethencourt is a freedom-lover technocrat, and has always enjoyed programming and playing around with video, so since he discovered GStreamer years ago he's been hooked. Originally from the Canary Islands, computers felt like a door to the world, and saw in Linux the best way to open it, see how it all works, and become a part of it. He currently works for Collabora and enjoys contributing to projects like Gstreamer Editing Services, Rygel, PiTiVi, freemix or snappy.

Talk Abstract

Luis de Bethencourt will be hosting a round table with 3 GStreamer Experts: Jan Schmidt, Sebastian Dröge, and Tim P. Müller. This personal, instead of technical, Q&A will be driven by the audience questions to the table about their experience learning, progressing, and contributing in GStreamer. Leading and inspiring by example the experts will talk about the help, tricks, mistakes and bumps each one of them experienced in their road to GStreamer expertise.

Report a problem on this page.