no code implementations • 15 Feb 2024 • Matthias Kränzler, Christian Herglotz, André Kaup
By using multiple video codecs for model training, we can predict the complexity of a HW decoder with an error of less than 8% and a minimum error of 4. 54% without using the corresponding HW decoder for training.
no code implementations • 14 Feb 2024 • Matthias Kränzler, Christian Herglotz, André Kaup
We find that AV1 is a sweet spot for optimized software decoder implementations with an additional energy demand of 16. 55% and bitrate savings of -43. 95% compared to VP9.
no code implementations • 29 Jan 2024 • Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, Christian Herglotz, André Kaup
We propose an encoding time and energy model for SVT-AV1 based on empirical relations between the encoding time and video parameters as well as encoder configurations.
no code implementations • 26 Oct 2023 • Christian Herglotz, Matthias Kränzler, Xixue Chu, Edouard Francois, Yong He, André Kaup
In this paper, we discuss one aspect of the latest MPEG standard edition on energy-efficient media consumption, also known as Green Metadata (ISO/IEC 232001-11), which is the interactive signaling for remote decoder-power reduction for peer-to-peer video conferencing.
no code implementations • 13 Sep 2023 • Christian Herglotz, David Müller, Andreas Weinlich, Frank Bauer, Michael Ortner, Marc Stamminger, André Kaup
This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences.
no code implementations • 12 Aug 2023 • Kristian Fischer, Christian Herglotz, André Kaup
Coding 4K data has become of vital interest in recent years, since the amount of 4K data is significantly increasing.
no code implementations • 26 Jul 2023 • Christian Herglotz, André Kaup
In this paper, we show that processor events like instruction counts or cache misses can be used to accurately estimate the processing energy of software video decoders.
no code implementations • 17 Jul 2023 • Christian Herglotz, Stéphane Coulombe, Ahmad Vakili, André Kaup
This paper proposes a method to evaluate and model the power consumption of modern virtual reality playback and streaming applications on smartphones.
no code implementations • 17 Jul 2023 • Christian Herglotz, André Kaup, Stéphane Coulombe, Ahmad Vakili
This paper derives optimal spatial scaling and rate control parameters for power-efficient wireless video streaming on portable devices.
no code implementations • 17 Jul 2023 • Christian Herglotz, Mohammadreza Jamali, Stéphane Coulombe, Carlos Vazquez, Ahmad Vakili
This paper presents an efficient method for encoding common projection formats in 360$^\circ$ video coding, in which we exploit inactive regions.
no code implementations • 17 Jul 2023 • Christian Herglotz, Simon Grosche, Akarsh Bharadwaj, André Kaup
This paper presents a novel method to estimate the power consumption of distinct active components on an electronic carrier board by using thermal imaging.
1 code implementation • 11 Jul 2023 • Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, André Kaup, Christian Herglotz
Current developments in video encoding technology lead to continuously improving compression performance but at the expense of increasingly higher computational demands.
no code implementations • 29 Jun 2023 • Christian Herglotz, Fabian Brand, Andy Regensky, Felix Rievel, André Kaup
Nowadays, the compression performance of neural-networkbased image compression algorithms outperforms state-of-the-art compression approaches such as JPEG or HEIC-based image compression.
no code implementations • 23 Jun 2023 • Andy Regensky, Christian Herglotz, André Kaup
Motion compensation is one of the key technologies enabling the high compression efficiency of modern video coding standards.
no code implementations • 12 Jun 2023 • Christian Herglotz, Matthias Kränzler, Robert Ludwig, André Kaup
In this paper, we study decoding energy reduction opportunities using temporal-domain filtering and subsampling methods.
no code implementations • 24 May 2023 • Christian Herglotz, Werner Robitza, Alexander Raake, Tobias Hossfeld, André Kaup
We find that based on the power consumption of the streaming sessions from the crowdsourcing dataset, devices could save more than 55% of power if all participants adhere to low-power settings.
1 code implementation • 25 Apr 2023 • Christian Herglotz, Hannah Och, Anna Meyer, Geetha Ramasubbu, Lena Eichermüller, Matthias Kränzler, Fabian Brand, Kristian Fischer, Dat Thanh Nguyen, Andy Regensky, André Kaup
Using additional supporting points inbetween standard points defined by parameters such as the quantization parameter, we assess the interpolation error of the Bj{\o}ntegaard-Delta (BD) calculus and its impact on the final BD value.
1 code implementation • 20 Jan 2023 • Kristian Fischer, Fabian Brand, Christian Herglotz, André Kaup
This is a well-known method for the human visual system, where scaling lists are derived from psycho-visual models.
no code implementations • 11 Dec 2022 • Geetha Ramasubbu, André Kaup, Christian Herglotz
To this end, this paper presents an energy estimator that uses a subset of bit stream features to accurately estimate the energy consumption of the HEVC software encoding process.
no code implementations • 8 Dec 2022 • Wolfgang Schnurrer, Thomas Richter, Jürgen Seiler, Christian Herglotz, André Kaup
We show that a 3-D mesh can obtain a higher quality of the lowpass band by 0. 28 dB with less than 40% of the model parameters of a comparable 2-D mesh.
no code implementations • 11 Oct 2022 • Christian Herglotz, Werner Robitza, Matthias Kränzler, André Kaup, Alexander Raake
In this paper, we perform a first analysis of both end-user power efficiency and Quality of Experience of a video streaming service.
no code implementations • 30 Sep 2022 • Christian Herglotz, Matthias Kränzler, Robert Schober, André Kaup
We discuss all relevant energy sinks, highlight dependencies with quality-of-service variables as well as video properties, review energy consumption models for different devices from the literature, and aggregate these existing models into a global model for the overall energy consumption of a generic online video service.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
We show that bit streams of the 360{\deg}, HDR, and fisheye video format can be estimated with a mean estimation error lower than 3. 88% if the setups have the same coding bit depth.
no code implementations • 21 Sep 2022 • Christian Herglotz, Geetha Ramasubbu, André Kaup
Recent research has shown that temporal downsampling of high-frame-rate sequences can be exploited to improve the rate-distortion performance in video coding.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
The evaluation shows that the energy demand of the VTM decoder is increased significantly compared to HM and that the increase depends on the coding configuration.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
In previous research, it was shown that the software decoding energy demand of High Efficiency Video Coding (HEVC) can be reduced by 15$\%$ by using a decoding-energy-rate-distortion optimization algorithm.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
In recent studies, it could be shown that the energy demand of Versatile Video Coding (VVC) decoders can be twice as high as comparable High Efficiency Video Coding (HEVC) decoders.
no code implementations • 6 Jul 2022 • Geetha Ramasubbu, André Kaup, Christian Herglotz
The global significance of energy consumption of video communication renders research on the energy need of video coding an important task.
no code implementations • 27 Jun 2022 • Matthias Kränzler, Adam Wieckowski, Geetha Ramasubbu, Benjamin Bross, André Kaup, Detlev Marpe, Christian Herglotz
We show that encoding using our proposed coding tool profiles, the decoding energy efficiency is improved by over 25% with a bit rate increase of less than 5% with respect to standard encoding.
no code implementations • 24 Jun 2022 • Christian Herglotz, Nils Genser, André Kaup
These savings are more than twice as high as savings obtained using competing methods from literature.
no code implementations • 13 May 2022 • Kristian Fischer, Christian Blum, Christian Herglotz, André Kaup
Deep neural object detection or segmentation networks are commonly trained with pristine, uncompressed data.
no code implementations • 13 May 2022 • Kristian Fischer, Christian Forsch, Christian Herglotz, André Kaup
Video and image coding for machines (VCM) is an emerging field that aims to develop compression methods resulting in optimal bitstreams when the decoded frames are analyzed by a neural network.
no code implementations • 21 Apr 2022 • Christian Herglotz, Yongjun Wen, Bowen Dai, Matthias Kränzler, André Kaup
In this paper we show that a small amount of bit stream features can be used to accurately estimate the energy consumption of state-of-the-art software and hardware accelerated decoder implementations for four different video codecs.
no code implementations • 11 Mar 2022 • Kristian Fischer, Christian Herglotz, André Kaup
Classical video coding for satisfying humans as the final user is a widely investigated field of studies for visual content, and common video codecs are all optimized for the human visual system (HVS).
no code implementations • 11 Mar 2022 • Kristian Fischer, Fabian Brand, Christian Herglotz, André Kaup
In this paper, we propose a standard-compliant feature-based RDO (FRDO) that is designed to increase the coding performance, when the decoded frame is analyzed by a neural network in a video coding for machine scenario.
no code implementations • 11 Mar 2022 • Kristian Fischer, Felix Fleckenstein, Christian Herglotz, André Kaup
Saliency-driven image and video coding for humans has gained importance in the recent past.
no code implementations • 3 Mar 2022 • Christian Herglotz, Rafael Rosales, Michael Glass, Jürgen Teich, André Kaup
Finding the best possible encoding decisions for compressing a video sequence is a highly complex problem.
no code implementations • 3 Mar 2022 • Christian Herglotz, Dominic Springer, Andrea Eichenseer, André Kaup
Battery life is one of the major limitations to mobile device use, which makes research on energy efficient soft- and hardware an important task.
no code implementations • 3 Mar 2022 • Christian Herglotz, Jürgen Seiler, André Kaup, Arne Hendricks, Marc Reichenbach, Dietmar Fey
In recent years, due to a higher demand for portable devices, which provide restricted amounts of processing capacity and battery power, the need for energy and time efficient hard- and software solutions has increased.
no code implementations • 3 Mar 2022 • Christian Herglotz, Elisabeth Walencik, André Kaup
This paper presents a method to accurately estimate the required decoding energy for a given HEVC software decoding solution.
no code implementations • 3 Mar 2022 • Christian Herglotz, André Kaup
This paper presents a novel algorithm that aims at minimizing the required decoding energy by exploiting a general energy model for HEVC-decoder solutions.
no code implementations • 2 Mar 2022 • Christian Herglotz, Andreas Heindel, André Kaup
Finally, measurements of the software decoding process for HEVC-coded bit streams are performed.
no code implementations • 1 Mar 2022 • Christian Herglotz, Dominic Springer, Marc Reichenbach, Benno Stabernack, André Kaup
To show the modeling capabilities in general, we test the estimation performance for different decoding software and hardware solutions, where we find that the proposed model outperforms the models from literature by reaching frame-wise mean estimation errors of less than 7% for software and less than 15% for hardware based systems.
no code implementations • 28 Feb 2022 • Andy Regensky, Christian Herglotz, André Kaup
However, the approach does not consider the large field of view of fisheye lenses that requires the consideration of different motion planes in 3D space.
no code implementations • 25 Feb 2022 • Christian Herglotz, Matthias Kränzler, Ruben Mons, André Kaup
For 20 years, the gold standard to evaluate the performance of video codecs is to calculate average differences between ratedistortion curves, also called the "Bj{\o}ntegaard Delta".
no code implementations • 15 Feb 2022 • Fabian Brand, Christian Herglotz, André Kaup
There are many tasks within video compression which require fast bit rate estimation.
no code implementations • 7 Feb 2022 • Andy Regensky, Christian Herglotz, André Kaup
Based on the known projection format of the video, MPA allows to perform inter prediction on different motion planes in 3D space instead of having to work on the - in theory arbitrarily mapped - 2D image representation directly.
no code implementations • 23 Nov 2021 • Matthias Kränzler, Christian Herglotz, André Kaup
IP traffic has increased significantly in recent years, and it is expected that this progress will continue.