Media and creative sector

Kanalsteuerung von Audiosignalen am Mischpult.
© magati/Fotolia.com

The digitalization and convergence of different media are driving technological as well as cultural change. The way we utilize media has fundamentally changed: everywhere we go we are constantly accessing the content we are looking for – independent of whether it is text, images, videos, or games. This immeasurable amount of content must be recorded, made accessible, stored, transmitted, and presented. In addition, we interact more than ever with other users and communities by producing our own content, transmitting
it, and assessing it. This use of media requires dependable transmission formats and stable network connections, as well as reliable protection mechanisms.

Entertainment and media of tomorrow

Entertainment and media of tomorrow are characterized by personalized information services, multi-screen applications, interactive television, and high-resolution 3D presentation
of sound and image. All sorts of hybrids and hierarchies of devices facilitate simultaneous use and seamless transition between them, so that the borders between screens, set-top boxes, tablet computers, and gadgets increasingly disappear. Every medium benefits from the strength of the others. Intelligent algorithms and intuitive control embedded in a common interface for operating the devices permit the users to concentrate entirely on the content.

Culture and digital learning give rise to new approaches and formats through the use of new media that are interactive and participative. At the same time, there is also the opportunity to make up-to-date knowledge and traditional global cultural heritage accessible to everyone in visual form. Entertainment, information, and learning are available every- where through mobile service and devices. Different types of adaptive (educational) computer games become widespread at nearly all levels of society and are part of our day-to-day culture. New types of games that more powerfully involve the player and the environment are able to address continually new target groups.

Film and television use digitalization of production, marketing, and distribution processes, which satisfies a pre- requisite for advanced formats. The television allows viewers to be more involved in events through better image and
audio quality as well as through opportunities for interaction. Film theaters attract viewers with high-resolution 3D films
and superior spatial sound for feature films as well as for transmission and presentation of musical and sporting events. Concerts and live events also acquire a completely new experiential dimension thanks to 3D sound.

Projekt HEVC

Example project from Fraunhofer HHI, Berlin

High Efficiency Video Coding (HEVC) is the next-generation video compression standard. It was developed by the Joint Collaborative Team on Video Coding (JCT-VC) to which Fraunhofer made important contributions. Compared to its predecessor H.264/AVC, HEVC achieves about a 50 percent reduction in bit rate for the same quality video. Since the standard has been finalized, Fraunhofer also develops software and hardware solutions that benefit from the outstanding characteristics of HEVC.

Project page

High Efficiency Video Coding auf dem Tablet und dem Fernseher
© Fraunhofer HHI

High Efficiency Video Coding (HEVC) is the next-generation video compression standard.

Scientific publications

YearTitle/AuthorDocument Type
2019Delay Impact on MPEG OMAF's Tile-Based Viewport-Dependent 360° Video Streaming
Fuente, Y.S. de la; Bhullar, G.S.; Skupin, R.; Hellge, C.; Schierl, T.
Journal Article
2019Dynamic Non-Regular Sampling Sensor Using Frequency Selective Reconstruction
Jonscher, M.; Seiler, J.; Lanz, D.; Schöberl, M.; Bätz, M.; Kaup, A.
Journal Article
2019Effects of Visually Induced Motion Sickness on Emergency Braking Reaction Times in a Driving Simulator
Reinhard, R.; Tutulmaz, E.; Rutrecht, H.; Hengstenberg, P.; Geissler, B.; Hecht, H.; Muttray, A.
Journal Article
2019Evaluation of shared resource allocation using SAND for ABR streaming
Pham, Stefan; Heeren, Patrick; Silhavy, Daniel; Arbanowski, Stefan
Conference Paper
2019Quality of experience tests of an object-based radio reproduction app on a mobile device
Silzle, A.; Schmidt, R.; Bleisteiner, W.; Epain, N.; Ragot, M.
Journal Article
2019Source separation for enabling dialogue enhancement in object-based broadcast with MPEG-H
Paulus, J.; Torcoli, M.; Uhle, C.; Herre, J.; Disch, S.; Fuchs, H.
Journal Article
2018Akustische Qualitätskontrolle mit künstlicher Intelligenz
Liebetrau, Judith; Grollmisch, Sascha; Clauß, Tobias
Journal Article
2018Analyzing player networks in Destiny
Pirker, J.; Rattinger, A.; Drachen, A.; Sifa, R.
Journal Article
2018Audiocodecs. Hörgenuss aus der digitalen Welt
Brandenburg, Karlheinz; Sladeczek, Christoph
Book Article
2018Context-based fractional sample refinement for HEVC compliant encoding
Maier, Georg; Bross, B.; Grois, D.; Marpe, D.; Schwarz, H.; Veltkamp, R.; Wiegand, T.
Journal Article
2018Fast template matching for intra prediction
Venugopal, G.; Merkle, P.; Marpe, D.; Wiegand, T.
Conference Paper
2018Future Video Coding Technologies: A Performance Evaluation of AV1, JEM, VP9, and HM
Nguyen, T.; Marpe, D.
Conference Paper
2018Neural network based intra prediction for video coding
Pfaff, J.; Helle, P.; Maniry, D.; Kaltenstadler, S.; Samek, W.; Schwarz, H.; Marpe, D.; Wiegand, T.
Conference Paper
2018On the current state of interoperable content protection for internet video streaming
Pham, Stefan; Kuipou, Franck Russel; Arbanowski, Stefan; Steglich, Stephan
Conference Paper
2018Risk and crisis communication in Colombia: A case study from Medellín
Klafft, Michael; Schreiber, Pia
Conference Paper
2018A Signal Adaptive Diffusion Filter For Video Coding
Rasch, J.; Pfaff, J.; Schäfer, M.; Schwarz, H.; Winken, M.; Siekmann, M.; Marpe, D.; Wiegand, T.
Conference Paper
2018Standardization status of 360 degree video coding and delivery
Skupin, R.; Sanchez, Y.; Wang, Y.-K.; Hannuksela, M.M.; Boyce, J.; Wien, M.
Conference Paper
2018Streaming and playback of 16k 360° videos on the web
Bassbouss, Louay; Pham, Stefan; Steglich, Stephan
Conference Paper
2018Viewport-dependent 360 degree video streaming based on the emerging Omnidirectional Media Format (OMAF) standard
Skupin, R.; Sanchez, Y.; Podborski, D.; Hellge, C.; Schierl, T.
Conference Paper
2017Building the world's most complex TV network. A test bed for broadcasting immersive and interactive audio
Bleidt, Robert; Thoma, Herbert; Fiesel, Wolfgang; Krägeloh, Stefan; Fuchs, Harald; Zeh, Rinat; DeFilippis, Jim; Weiss, Merrill
Journal Article
2017Coding of fine granular audio signals using High Resolution Envelope Processing (HREP)
Ghido, Floran; Disch, Sascha; Herre, Juergen; Reutelhuber, Frank; Adami, Alexander
Conference Paper
2017Development of the MPEG-H TV Audio System for ATSC 3.0
Bleidt, R.L.; Sen, D.; Niedermeier, A.; Czelhan, B.; Füg, S.; Disch, S.; Herre, J.; Hilpert, J.; Neuendorf, M.; Fuchs, H.; Issing, J.; Murtaza, A.; Kuntz, A.; Kratschmer, M.; Küch, F.; Füg, R.; Schubert, B.; Dick, S.; Fuchs, G.; Schuh, F.; Burdiel, E.; Peters, N.; Kim, M.-Y.
Journal Article
2017Dynamic ad-insertion and content orchestration workflows through manifest manipulation in HLS and MPEG-DASH
Seeliger, Robert; Silhavy, Daniel; Arbanowski, Stefan
Conference Paper
2017Enabling wide area data analytics with collaborative distributed processing pipelines (CDPPs)
Feldmann, Anja; Hauswirth, Manfred; Markl, Volker
Conference Paper
2017Extended cross-component prediction in HEVC
Siekmann, M.; Khairat, A.; Nguyen, T.; Marpe, D.; Wiegand, T.
Journal Article
2017HEVC tile based streaming to head mounted displays
Skupin, R.; Sanchez, Y.; Podborski, D.; Hellge, C.; Schierl, T.
Conference Paper
2017The image-interpretation-workstation of the future: Lessons learned
Maier, Sebastian; Camp, Florian van de; Hafermann, J.; Wagner, Boris; Peinsipp-Byma, Elisabeth; Beyerer, Jürgen
Conference Paper
2017MP3 partial encryption for DRM
Steinebach, Martin; Berchtold, Waldemar
Conference Paper
2017Object based approach for electronic variable acoustics systems
Frutos-Bonilla, Javier; Brix, Sandra; Sladeczek, Christoph; Rodigast, Rene; Munster, Bjorn van
Journal Article
2017Odor in immersive environments
Dangelmaier, Manfred; Blach, Roland
Book Article
2017Phylogeny analysis for MP3 and AAC coding transformations
Maksimovic, Milica; Cuccovillo, Luca; Aichroth, Patrick
Conference Paper
2017Reinforcement learning for video encoder control in HEVC
Helle, P.; Schwarz, H.; Wiegand, T.; Müller, K.-R.
Conference Paper
2017Rixels: Towards secure interactive 3D graphics in engineering clouds
Altenhofen, Christian; Dietrich, Andreas; Stork, André; Fellner, Dieter W.
Conference Paper
2017Simulation-based HW/SW co-exploration of the concurrent execution of HEVC intra encoding algorithms for heterogeneous multi-core architectures
Brandenburg, J.; Stabernack, B.
Journal Article
2017A standards-based OTT DRM ecosystem with CMAF, CENC and CPIX
Pham, Stefan; Kuipou, Franck Russel; Arbanowski, Stefan
Conference Paper
2017Video processing for panoramic streaming using HEVC and its scalable extensions
Sanchez de la Fuente, Y.; Skupin, R.; Schierl, T.
Journal Article
2017Zisch oder Tzisch? Akustische Qualitätskontrolle in der Getränkeherstellung
Liebetrau, Judith; Grollmisch, Sascha; Clauß, Tobias
Journal Article
2016 Psychoacoustics of detection of tonality and asymmetry of masking: implementation of tonality estimation methods in a psychoacoustic model for perceptual audio coding: Psychoakustik der Tonalitätswahrnehmung und der Maskierungsasymmetrie: Implementierung von Tonalitätsschätzverfahren in einem psychoakustischen Modell für die wahrnehmungsbasierte Audiocodierung
Taghipour, A.
Dissertation
2016AAC encoding detection and bitrate estimation using a convolutional neural network
Seichter, Daniel; Cuccovillo, Luca; Aichroth, Patrick
Conference Paper
2016Advanced human machine interaction for an image interpretation workstation
Maier, Sebastian; Martin, Manuel; Camp, Florian van de; Peinsipp-Byma, Elisabeth; Beyerer, Jürgen
Conference Paper
2016Application of wave field synthesis in virtual acoustic engineering
Bergner, Jakob; Clauss, Tobias; Zhykhar, Albert; Sladeczek, Christoph; Brix, Sandra
Conference Paper
2016Audio coding using overlap and kernel adaptation
Helmrich, Christian R.; Edler, Bernd
Journal Article
2016Block adaptive selection of multiple core transforms for video coding
De-Luxan-Hernandez, S.; Marpe, D.; Schwarz, H.; Müller, K.-R.; Wien, M.; Ohm, J.-R.; Wiegand, T.
Conference Paper
2016Building the world's most complex TV network (A test bed for broadcasting immersive and interactive Audio1)
Bleidt, R.; Thoma, H.; Fiesel, W.; Kraegeloh, S.; Fuchs, H.; Zeh, R.; Filippis, J. de; Weiss, S.M.
Conference Paper
2016Coding efficiency comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC encoders
Grois, D.; Nguyen, T.; Marpe, D.
Conference Paper
2016Complexity scaling of audio algorithms: Parametrizing the MPEG advanced audio coding rate-distortion loop
Delgado, P.; Lohwasser, M.
Conference Paper
2016Cross-platform ad-insertion using HbbTV and MPEG-DASH
Seeliger, Robert; Silhavy, Daniel; Pham, Stefan; Arbanowski, Stefan
Conference Paper
2016Delay-reduced mode of MPEG-4 enhanced low delay AAC (AAC-ELD)
Schnell, Markus; Jaegers, Wolfgang; Delgado, Pablo; Benndorf, Conrad; Albert, Tobias; Lutzky, Manfred
Conference Paper
2016Depth intra coding for 3D video based on geometric primitives
Merkle, P.; Müller, K.; Marpe, D.; Wiegand, T.
Journal Article
2016Distracting people from sources of discomfort in a simulated aircraft environment
Lewis, Laura; Patel, Harshada; Cobb, Sue; D'Cruz, Mirabelle; Bues, Matthias; Stefani, Oliver; Grobler, Tredeaux
Journal Article
2016Efficient multichannel audio transform coding with low delay and complexity
Schuh, Florian; Dick, Sascha; Füg, Richard; Helmrich, Christian; Rettelbach, Nikolaus; Schwegler, Tobias
Conference Paper
2016High-directional beamforming with a miniature loudspeaker array
Sladeczek, C.; Beer, D.; Bergner, J.; Zhykhar, A.; Wolf, M.; Franck, A.
Conference Paper
2016Hybrid video object tracking in H.265/HEVC video streams
Gül, S.; Meyer, J.T.; Hellge, C.; Schierl, T.; Samek, W.
Conference Paper
2016Impact of hyperspectral image coding on subpixel detection
Pestel-Schiller, Ulrike; Vogt, Karsten; Ostermann, Jörn; Groß, Wolfgang
Conference Paper
2016Implementing dynamic ad insertion in HTML5 using MPEG dash
Pham, Stefan; Hughes, Kilroy; Lohmar, Thorsten
Conference Paper
2016Intelligent gap filling in perceptual transform coding of audio
Disch, S.; Niedermeier, A.; Helmrich, C.R.; Neukam, C.; Schmidt, K.; Geiger, R.; Lecomte, J.; Ghido, F.; Nagel, F.; Edler, B.
Conference Paper
2016Interactive Storytelling & Audio Apps for HbbTV: Vortrag gehalten auf dem Forum Medientechnik und All Around Audio Symposium, 23./24. November 2016, St.Pölten
Patz, Nico; Brennecke, Angela; Fuhrhop, Christian
Presentation
2016Introduction to the Special Issue on HEVC Extensions and Efficient HEVC Implementations
Ohm, J.R.; Sullivan, G.J.; Sze, V.; Wiegand, T.; Budagavi, M.
Journal Article
2016Object based (spatial) audio technologies for live and entertainment industries
Rodigast, R.; Munster, B. van
Conference Paper
2016Open-set microphone classification via blind channel analysis
Cuccovillo, Luca; Aichroth, Patrick
Conference Paper
2016Overview of the multiview and 3D extensions of high efficiency video coding
Tech, G.; Chen, Y.; Müller, K.; Ohm, J.-R.; Vetro, A.; Wang, Y.-K.
Journal Article
2016Overview of the range extensions for the HEVC standard: Tools, profiles, and performance
Flynn, D.; Marpe, D.; Naccari, M.; Nguyen, T.; Rosewarne, C.; Sharman, K.; Sole, J.; Xu, J.Z.
Journal Article
2016Peak bitrate reduction for multi-party video conferencing using SHVC
Sanchez, Y.; Skupin, R.; Hellge, C.; Schierl, T.
Conference Paper
2016Personalized dynamic ad insertion with MPEG DASH
Pham, Stefan; Krauss, Christopher; Silhavy, Daniel; Arbanowski, Stefan
Conference Paper
2016Quality assessment of image patches distorted by image compression using crowdsourcing
Bosse, S.; Siekmann, M.; Rasch, J.; Wiegand, T.; Samek, W.
Conference Paper
2016Rixels: Towards secure interactive 3D graphics in engineering clouds
Altenhofen, Christian; Dietrich, Andreas; Stork, André; Fellner, Dieter W.
Journal Article
2016Shifted IDR representations for low delay live DASH streaming using HEVC tiles
Sanchez, Y.; Podborski, D.; Hellge, C.; Schierl, T.
Conference Paper
2016Signal-adaptive switching of overlap ratio in audio transform coding
Helmrich, Christian; Edler, Bernd
Conference Paper
2016Simulation based analysis of memory access conflicts for heterogeneous multi-core platforms
Brandenburg, J.; Stabernack, B.
Conference Paper
2016Tile based HEVC video for head mounted displays
Skupin, R.; Sanchez, Y.; Hellge, C.; Schierl, T.
Conference Paper
20154k/UHD-Live-Encoding mit High Efficiency Video Coding (HEVC)
Bross, B.; Palkow, M.; Schwarz, H.
Journal Article
2015Carl Adam Petri. Life and Science
Smith, Einar
Book
2015Compositing without transcoding for H.265/HEVC in cloud IPTV and VoD services
Mikityuk, A.; Friedrich, O.; Skupin, R.; Sanchez, Y.; Schierl, T.
Conference Paper
2015Compressed domain processing for stereoscopic tile based panorama streaming using MV-HEVC
Skupin, R.; Sanchez, Y.; Schierl, T.
Conference Paper
2015Compressed domain video compositing with HEVC
Skupin, R.; Sanchez, Y.; Schierl, T.
Conference Paper
2015Compressed domain video processing for tile based panoramic streaming using HEVC
Sanchez, Y.; Skupin, R.; Schierl, T.
Conference Paper
2015Cross-component prediction in HEVC
Kim, W.-S.; Pu, W.; Khairat, A.; Siekmann, M.; Sole, J.; Chen, J.; Karczewicz, M.; Nguyen, T.; Marpe, D.
Journal Article
2015Delta global illumination for mixed reality
Thöner, Maik; Kuijper, Arjan
Conference Paper
2015Demonstrating an FPGA implementation of a full HD real-time HEVC decoder with memory optimizations for range extensions support
Stabernack, B.; Möller, J.; Hahlbeck, J.; Brandenburg, J.
Conference Paper
2015Design, coding and processing of metadata for object-based interactive audio
Füg, S.; Hölzer, A.; Borß, C.; Ertel, C.; Kratschmer, M.; Plogsties, J.
Conference Paper
2015Designing with image schemas. Resolving the tension between innovation, inclusion and intuitive use
Hurtienne, Jörn; Klöckner, Kerstin; Diefenbach, Sarah; Nass, Claudia; Maier, Andreas
Journal Article
2015Dynamic range and loudness control in MPEG-H 3D audio
Kuech, F.; Kratschmer, M.; Neugebauer, B.; Meier, M.; Baumgarte, F.
Conference Paper
2015EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs)
Acqualagna, L.; Bosse, S.; Porbadnigk, A.K.; Curio, G.; Müller, K.R.; Wiegand, T.; Blankertz, B.
Journal Article
2015Exploring the concurrent execution of HEVC intra encoding algorithms for heterogeneous multi core architectures
Brandenburg, J.; Stabernack, B.
Conference Paper
2015Extended cross-component prediction in HEVC
Nguyen, Tung; Khairat, A.; Marpe, D.; Siekmann, M.; Wiegand, T.
Conference Paper
2015Foreign object detection in tires by acoustic event detection
Schröder, Jens; Brandes, Moritz; Hollosi, Danilo; Wellmann, Jan; Wittorf, Marten; Jung, Oliver; Grützmacher, Volker; Goetze, Stefan
Conference Paper
2015Frequency-domain comfort noise generation for discontinuous transmission in EVS
Lombard, Anthony; Wilde, Stephan; Ravelli, Emmanuel; Dohla, Stefan; Fuchs, Guillaume; Dietz, Martin
Conference Paper
2015A gesture recognition method for proximity-sensing surfaces in smart environments
Fu, Biying; Große-Puppendahl, Tobias; Kuijper, Arjan
Conference Paper
2015HEVC-compatible extensions for advanced coding of 3D and multiview video
Vetro, A.; Chen, Ying; Mueller, K.
Conference Paper
2015Indoor localization based on electric potential sensing
Dellangnol, Xavier; Große-Puppendahl, Tobias (Supervisor); Fu, Biying (Supervisor)
Master Thesis
2015Introduction of a file-system with integrated scaling capability
Sparenberg, H.; Foessel, S.
Conference Paper
2015ISO/MPEG-H 3D audio: SAOC-3D decoding and rendering
Murtaza, A.; Herre, J.; Paulus, J.; Terentiv, L.; Fuchs, H.; Disch, S.
Conference Paper
2015Localization of audio objects in multichannel reproduction systems
Sporer, T.; Liebetrau, J.; Werner, S.; Kepplinger, S.; Gabb, T.; Sieder, T.
Conference Paper
2015Low-complexity semi-parametric joint-stereo audio transform coding
Helmrich, Christian R.; Niedermeier, Andreas; Bayer, Stefan; Edler, Bernd
Conference Paper
2015Low-delay transform coding using the MPEG-H 3D audio codec
Helmrich, C.R.; Fischer, M.
Conference Paper
2015MPEG-D spatial audio object coding for dialogue enhancement (SAOC-DE)
Paulus, Jouni; Herre, Juergen; Murtaza, Adrian; Terentiv, Leon; Fuchs, Harald; Disch, Sascha; Ridderbusch, Falko
Conference Paper
2015MPEG-H 3D Audio - The new standard for coding of immersive spatial audio
Herre, Jürgen; Hilpert, Johannes; Kuntz, Achim; Plogsties, Jan
Journal Article
2015Multi-frame optimized quantization for high efficiency video coding
Winken, M.; Roth, A.; Schwarz, H.; Wiegand, T.
Conference Paper
2015Object-based audio: Opportunities for improved listening experience and increased listener involvement
Bleidt, R.; Borsum, A.; Fuchs, H.; Weiss, S.M.
Journal Article
2015Objective performance evaluation of the HEVC main still picture profile
Nguyen, T.; Marpe, D.
Journal Article
2015An Open Source Content Decryption Module to improve DRM integration with HTML5 platforms
Pham, S.; Arbanowski, S.; Kaiser, S.
Conference Paper
2015Overview of the EVS codec architecture
Dietz, Martin; Multrus, Markus; Eksler, Vaclav; Malenowski, Vladimir; Norvell, Erik; Pobloth, Harald; Lei, Miao; Zhe, Wang; Laaksonen, Lasse; Vasilache, Adriana; Kamamoto, Yutaka; Kikuiri, Kei; Ragot, Stephane; Faure, Julien; Ehara, Hiroyuki; Rajendran, Vivek; Atti, Venkatraman; Sung, Hosang; Oh, Eunmi; Yuan, Hao; Zhu, Changbao
Conference Paper
2015Parameter extraction for bass guitar sound models including playing styles
Schuller, Gerald; Abeßer, Jakob; Kehling, Christian
Conference Paper
2015Pattern-based integer sample motion search strategies in the context of HEVC
Maier, Georg; Bross, B.; Grois, D.; Marpe, D.; Schwarz, H.; Veltkamp, R.C.; Wiegand, T.
Conference Paper
2015Perceptual loudness compensation in interactive object-based audio coding systems
Paulus, Jouni
Conference Paper
2015Producing interactive immersive sound for MPEG-H. A field test for sports broadcasting
Stenzel, H.; Scuda, U.
Conference Paper
2015Rate-distortion optimised quantisation for HEVC using spatial just noticeable distortion
Dias, A.S.; Siekmann, M.; Bosse, S.; Schwarz, H.; Marpe, D.; Mrak, M.
Conference Paper
2015A robust speech/music discriminator for switched audio coding
Fuchs, G.
Conference Paper
2015SIMD acceleration for HEVC decoding
Chi, C.C.; Alvarez-Mesa, M.; Bross, B.; Juurlink, B.; Schierl, T.
Journal Article
2015Temporal tile shaping for spectral gap filling in audio transform coding in EVS
Disch, Sascha; Neukam, Christian; Schmidt, Konstantin
Conference Paper
2015Themed Passenger Carriages: Promoting Commuters’ Happiness on Rapid Transit Systems through Ambient and Aesthetic Intelligence
Rui, A.S.; Plewe, D.A.; Röcker, C.
Journal Article
2015Towards a structured selection of game engines for virtual environments
Westhoven, Martin; Alexander, Thomas
Conference Paper
2015Two-level sliding-window VBR control algorithm for video on demand streaming
Frutos-Lopez, M. de; Gonzalez-de-Suso, J.L.; Sanz-Rodriguez, S.; Pelaez-Moreno, C.; Diaz-de-Maria, F.
Journal Article
2015Underwater mixed environments
Lukas, Uwe von; Quarles, John; Kaklis, Panagiotis; Dolereit, Tim
Conference Paper
This publication list has been generated from the publication database Fraunhofer-Publica.