no code implementations • 15 Feb 2024 • Matthias Kränzler, Christian Herglotz, André Kaup
By using multiple video codecs for model training, we can predict the complexity of a HW decoder with an error of less than 8% and a minimum error of 4. 54% without using the corresponding HW decoder for training.
no code implementations • 15 Feb 2024 • Andy Regensky, Fabian Brand, André Kaup
As such, the state-of-the-art H. 266/VVC video coding standard integrates dedicated tools for 360-degree video, and considerable efforts have been put into designing 360-degree projection formats with improved compression efficiency.
no code implementations • 14 Feb 2024 • Matthias Kränzler, Christian Herglotz, André Kaup
We find that AV1 is a sweet spot for optimized software decoder implementations with an additional energy demand of 16. 55% and bitrate savings of -43. 95% compared to VP9.
1 code implementation • 30 Jan 2024 • Srivatsa Prativadibhayankaram, Mahadev Prasad Panda, Thomas Richter, Heiko Sparenberg, Siegfried Fößel, André Kaup
We propose the structure and color based learned image codec (SLIC) in which the task of compression is split into that of luminance and chrominance.
no code implementations • 29 Jan 2024 • Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, Christian Herglotz, André Kaup
We propose an encoding time and energy model for SVT-AV1 based on empirical relations between the encoding time and video parameters as well as encoder configurations.
no code implementations • 22 Dec 2023 • Hannah Och, Shabhrish Reddy Uddehal, Tilo Strutz, André Kaup
Compared to VVC and HEVC, the proposed method needs roughly 0. 44 and 0. 17 bits per pixel less on average for 24-bit screen content images, respectively.
no code implementations • 18 Dec 2023 • Esin Koyuncu, Timofey Solovyev, Johannes Sauer, Elena Alshina, André Kaup
Learned image compression has a problem of non-bit-exact reconstruction due to different calculations of floating point arithmetic on different devices.
1 code implementation • 14 Dec 2023 • Andy Regensky, André Kaup
The large amounts of data associated with 360-degree video require highly effective compression techniques for efficient storage and distribution.
no code implementations • 14 Dec 2023 • Frank Sippel, Jürgen Seiler, André Kaup
Thus, in this paper an upsampling method for SWIR images guided by a visible image is presented.
no code implementations • 14 Dec 2023 • Frank Sippel, Nils Genser, Hannah Och, Jürgen Seiler, André Kaup
The theoretical examination of the novel color agnostic method is completed by an extensive evaluation compared to state of the art including self-recorded multispectral data and a reference implementation.
no code implementations • 26 Oct 2023 • Christian Herglotz, Matthias Kränzler, Xixue Chu, Edouard Francois, Yong He, André Kaup
In this paper, we discuss one aspect of the latest MPEG standard edition on energy-efficient media consumption, also known as Green Metadata (ISO/IEC 232001-11), which is the interactive signaling for remote decoder-power reduction for peer-to-peer video conferencing.
no code implementations • 13 Sep 2023 • Christian Herglotz, David Müller, Andreas Weinlich, Frank Bauer, Michael Ortner, Marc Stamminger, André Kaup
This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences.
no code implementations • 12 Aug 2023 • Kristian Fischer, Christian Herglotz, André Kaup
Coding 4K data has become of vital interest in recent years, since the amount of 4K data is significantly increasing.
no code implementations • 26 Jul 2023 • Christian Herglotz, André Kaup
In this paper, we show that processor events like instruction counts or cache misses can be used to accurately estimate the processing energy of software video decoders.
no code implementations • 24 Jul 2023 • Fabian Brand, Jürgen Seiler, André Kaup
Conditional coding is a new video coding paradigm enabled by neural-network-based compression.
no code implementations • 17 Jul 2023 • Christian Herglotz, André Kaup, Stéphane Coulombe, Ahmad Vakili
This paper derives optimal spatial scaling and rate control parameters for power-efficient wireless video streaming on portable devices.
no code implementations • 17 Jul 2023 • Christian Herglotz, Stéphane Coulombe, Ahmad Vakili, André Kaup
This paper proposes a method to evaluate and model the power consumption of modern virtual reality playback and streaming applications on smartphones.
no code implementations • 17 Jul 2023 • Christian Herglotz, Simon Grosche, Akarsh Bharadwaj, André Kaup
This paper presents a novel method to estimate the power consumption of distinct active components on an electronic carrier board by using thermal imaging.
no code implementations • 12 Jul 2023 • Fabian Brand, Alexander Kopte, Kristian Fischer, André Kaup
Current state-of-the-art neural-network-based image compression systems however use only one scale to transmit the latent space.
1 code implementation • 11 Jul 2023 • Lena Eichermüller, Gaurang Chaudhari, Ioannis Katsavounidis, Zhijun Lei, Hassene Tmar, André Kaup, Christian Herglotz
Current developments in video encoding technology lead to continuously improving compression performance but at the expense of increasingly higher computational demands.
no code implementations • 29 Jun 2023 • Christian Herglotz, Fabian Brand, Andy Regensky, Felix Rievel, André Kaup
Nowadays, the compression performance of neural-networkbased image compression algorithms outperforms state-of-the-art compression approaches such as JPEG or HEIC-based image compression.
1 code implementation • 27 Jun 2023 • Frank Sippel, Jürgen Seiler, André Kaup
Since only little cross spectral data is available for training, this neural network is highly regularized.
1 code implementation • 23 Jun 2023 • Andy Regensky, Viktoria Heimann, Ruoyu Zhang, André Kaup
The conversion between different spherical image and video projection formats requires highly accurate resampling techniques in order to minimize the inevitable loss of information.
no code implementations • 23 Jun 2023 • Andy Regensky, Christian Herglotz, André Kaup
Motion compensation is one of the key technologies enabling the high compression efficiency of modern video coding standards.
no code implementations • 12 Jun 2023 • Christian Herglotz, Matthias Kränzler, Robert Ludwig, André Kaup
In this paper, we study decoding energy reduction opportunities using temporal-domain filtering and subsampling methods.
no code implementations • 25 May 2023 • Anna Meyer, Fabian Brand, André Kaup
In our experiments, we compare our MCTF-based approach to learning-based conditional coders and traditional hybrid video coding.
no code implementations • 24 May 2023 • Christian Herglotz, Werner Robitza, Alexander Raake, Tobias Hossfeld, André Kaup
We find that based on the power consumption of the streaming sessions from the crowdsourcing dataset, devices could save more than 55% of power if all participants adhere to low-power settings.
no code implementations • 10 May 2023 • Shabhrish Reddy Uddehal, Tilo Strutz, Hannah Och, André Kaup
For SCIs with natural regions, the proposed method achieves a bit-rate reduction of up to 11. 6% and 1. 52% with respect to HEVC and the previous version of the SCF.
no code implementations • 9 May 2023 • Hannah Och, Shabhrish Reddy Uddehal, Tilo Strutz, André Kaup
Screen content images typically contain a mix of natural and synthetic image parts.
no code implementations • 9 May 2023 • Marc Windsheimer, Fabian Brand, André Kaup
Most learning-based image compression methods lack efficiency for high image quality due to their non-invertible design.
1 code implementation • 25 Apr 2023 • Christian Herglotz, Hannah Och, Anna Meyer, Geetha Ramasubbu, Lena Eichermüller, Matthias Kränzler, Fabian Brand, Kristian Fischer, Dat Thanh Nguyen, Andy Regensky, André Kaup
Using additional supporting points inbetween standard points defined by parameters such as the quantization parameter, we assess the interpolation error of the Bj{\o}ntegaard-Delta (BD) calculus and its impact on the final BD value.
no code implementations • 24 Apr 2023 • Arya Rachman, Jürgen Seiler, André Kaup
The network is arranged in a Siamese-twin structure to constrain the network features learning to a mutually shared feature in both point cloud and camera (Lidar-camera constraint).
no code implementations • 9 Mar 2023 • Anna Meyer, André Kaup
In this paper, we explore a promising alternative approach for neural compression, with an autoencoder whose latent space represents a nonlinear wavelet decomposition.
no code implementations • 9 Mar 2023 • Anna Meyer, Nils Genser, André Kaup
In this paper, we propose a cross-spectral compression scheme for efficiently coding multispectral data based on HEVC.
no code implementations • 1 Mar 2023 • Wolfgang Schnurrer, Niklas Pallast, Thomas Richter, André Kaup
We propose an approach based on compensated wavelet lifting for obtaining a scalable representation of dynamic CT and MR volumes with very high quality.
no code implementations • 1 Mar 2023 • Andrea Eichenseer, Michel Bätz, André Kaup
Simulations and experiments are conducted on synthetic as well as real-world fisheye video sequences that are part of a data set created in the context of this paper.
no code implementations • 27 Feb 2023 • Kristian Fischer, Fabian Brand, Christian Blum, André Kaup
Areas without saliency are transmitted in latent spaces of lower spatial resolution in order to reduce the bitrate.
no code implementations • 3 Feb 2023 • Daniela Lanz, Franz Schilling, André Kaup
To improve the visual quality of the lowpass subband, motion compensation can be incorporated into the lifting structure, but leads to inferior compression results at the same time.
no code implementations • 3 Feb 2023 • Daniela Lanz, André Kaup
This work focuses on coding these adjacency matrices to make the graph-based motion compensation feasible for data compression.
no code implementations • 3 Feb 2023 • Wolfgang Schnurrer, Thomas Richter, Jürgen Seiler, André Kaup
Factorized in the lifting structure, the wavelet transform can easily be extended by arbitrary compensation methods.
no code implementations • 2 Feb 2023 • Daniela Lanz, André Kaup
Additionally, the similarity of the temporal base layer to the input sequence is preserved by the use of motion compensated temporal filtering.
no code implementations • 2 Feb 2023 • Daniela Lanz, Christian Herbert, André Kaup
Wavelet-based video coding decomposes an input sequence into a lowpass and a highpass subband by filtering along the temporal axis.
no code implementations • 2 Feb 2023 • Daniela Lanz, Jürgen Seiler, Karina Jaskolka, André Kaup
For the lossless compression of dynamic 3-D+t volumes as produced by medical devices like Computed Tomography, various coding schemes can be applied.
no code implementations • 27 Jan 2023 • Viktoria Heimann, Andreas Spruck, André Kaup
The attribute model is evaluated for the upsampled geometry positions.
1 code implementation • 20 Jan 2023 • Kristian Fischer, Fabian Brand, Christian Herglotz, André Kaup
This is a well-known method for the human visual system, where scaling lists are derived from psycho-visual models.
1 code implementation • 18 Jan 2023 • Frank Sippel, Jürgen Seiler, André Kaup
Two novel algorithms for two different applications are proposed to prove the diversity of applications that can be addressed by this novel database.
no code implementations • 12 Jan 2023 • Daniela Lanz, André Kaup
Medical applications like Computed Tomography (CT) or Magnetic Resonance Tomography (MRT) often require an efficient scalable representation of their huge output volumes in the further processing chain of medical routine.
no code implementations • 12 Jan 2023 • Daniela Lanz, André Kaup
An efficient scalable data representation is an important task especially in the medical area, e. g. for volumes from Computed Tomography (CT) or Magnetic Resonance Tomography (MRT), when a downscaled version of the original signal is needed.
no code implementations • 12 Jan 2023 • Wolfgang Schnurrer, Markus Jonscher, Jürgen Seiler, Thomas Richter, Michel Bätz, André Kaup
To enlarge the test set for evaluation we further propose a method to generate arbitrarily shaped lost areas.
no code implementations • 11 Jan 2023 • Wolfgang Schnurrer, Jürgen Seiler, Eugen Wige, André Kaup
A huge advantage of the wavelet transform in image and video compression is its scalability.
no code implementations • 11 Jan 2023 • Wolfgang Schnurrer, Jürgen Seiler, Michael Schöberl, André Kaup
Especially in lossless image coding the obtainable compression ratio strongly depends on the amount of noise included in the data as all noise has to be coded, too.
no code implementations • 11 Jan 2023 • Wolfgang Schnurrer, Tobias Tröger, Thomas Richter, Jürgen Seiler, André Kaup
Lossless image coding is a crucial task especially in the medical area, e. g., for volumes from Computed Tomography or Magnetic Resonance Tomography.
no code implementations • 11 Dec 2022 • Geetha Ramasubbu, André Kaup, Christian Herglotz
To this end, this paper presents an energy estimator that uses a subset of bit stream features to accurately estimate the energy consumption of the HEVC software encoding process.
no code implementations • 8 Dec 2022 • Wolfgang Schnurrer, Thomas Richter, Jürgen Seiler, Christian Herglotz, André Kaup
We show that a 3-D mesh can obtain a higher quality of the lowpass band by 0. 28 dB with less than 40% of the model parameters of a comparable 2-D mesh.
no code implementations • 8 Dec 2022 • Wolfgang Schnurrer, Jürgen Seiler, André Kaup
This paper presents a new approach for improving the visual quality of the lowpass band of a compensated wavelet transform.
no code implementations • 2 Dec 2022 • Esin Koyuncu, Timofey Solovyev, Elena Alshina, André Kaup
Learning-based image compression has improved to a level where it can outperform traditional image codecs such as HEVC and VVC in terms of coding performance.
no code implementations • 2 Dec 2022 • Andrea Eichenseer, Michel Bätz, André Kaup
Fisheye cameras prove a convenient means in surveillance and automotive applications as they provide a very wide field of view for capturing their surroundings.
no code implementations • 2 Dec 2022 • Hannah Och, Tilo Strutz, André Kaup
For each pixel to be encoded, a probability distribution is estimated based on the neighboring pattern and the occurrence of that pattern in the already encoded image.
no code implementations • 2 Dec 2022 • Andrea Eichenseer, Michel Bätz, André Kaup
A straightforward approach to disparity estimation is block matching, which performs well with perspective data.
no code implementations • 30 Nov 2022 • Andrea Eichenseer, André Kaup
In video surveillance as well as automotive applications, so-called fisheye cameras are often employed to capture a very wide angle of view.
no code implementations • 30 Nov 2022 • Andrea Eichenseer, Michel Bätz, Jürgen Seiler, André Kaup
Capturing large fields of view with only one camera is an important aspect in surveillance and automotive applications, but the wide-angle fisheye imagery thus obtained exhibits very special characteristics that may not be very well suited for typical image and video processing methods such as motion estimation.
no code implementations • 30 Nov 2022 • Andrea Eichenseer, André Kaup
Both methods make use of the latest video coding standard H. 265/HEVC and are compared with regard to objective as well as subjective video quality.
no code implementations • 21 Nov 2022 • Andrea Eichenseer, Jürgen Seiler, Michel Bätz, André Kaup
Wide-angle video sequences obtained by fisheye cameras exhibit characteristics that may not very well comply with standard image and video processing techniques such as error concealment.
no code implementations • 27 Oct 2022 • Viktoria Heimann, Andreas Spruck, André Kaup
Mostly, the visual data is transmitted from the application side to a central server where the interpretation is conducted.
no code implementations • 19 Oct 2022 • Viktoria Heimann, Andreas Spruck, André Kaup
High frame rates are desired in many fields of application.
no code implementations • 11 Oct 2022 • Christian Herglotz, Werner Robitza, Matthias Kränzler, André Kaup, Alexander Raake
In this paper, we perform a first analysis of both end-user power efficiency and Quality of Experience of a video streaming service.
no code implementations • 5 Oct 2022 • Maximiliane Gruber, Fabian Brand, Alina Mosebach, Jürgen Seiler, André Kaup
However, in practice unknown distortion can lead to a domain gap between training and test data, impeding the performance of a machine vision system.
no code implementations • 30 Sep 2022 • Christian Herglotz, Matthias Kränzler, Robert Schober, André Kaup
We discuss all relevant energy sinks, highlight dependencies with quality-of-service variables as well as video properties, review energy consumption models for different devices from the literature, and aggregate these existing models into a global model for the overall energy consumption of a generic online video service.
no code implementations • 28 Sep 2022 • Andreas Spruck, Maximilane Gruber, Anatol Maier, Denise Moussa, Jürgen Seiler, Christian Riess, André Kaup
The benefits of the proposed data generation pipeline, especially for machine learning scenarios with limited available training data, are demonstrated by an extensive experimental validation in the context of automatic license plate recognition.
no code implementations • 28 Sep 2022 • Andreas Spruck, Viktoria Heimann, André Kaup
Using an extensive experimental evaluation we show that depending on the network architecture and classification task the application of FSMR during training aids the learning process.
no code implementations • 27 Sep 2022 • Andreas Spruck, Maximiliane Hawesch, Anatol Maier, Christian Riess, Jürgen Seiler, André Kaup
Applying the proposed method, improvements of up to 2. 79 percentage points in terms of Character Error Rate (CER), and up to 7. 88 percentage points in terms of Word Error Rate (WER) are achieved on the subset.
no code implementations • 27 Sep 2022 • Andreas Spruck, Jürgen Seiler, Michael Roll, Thomas Dudziak, Jürgen Eckstein, André Kaup
Due to their special characteristics, the images must be pre-processed to enable the use of a deep neural network.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
The evaluation shows that the energy demand of the VTM decoder is increased significantly compared to HM and that the increase depends on the coding configuration.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
In recent studies, it could be shown that the energy demand of Versatile Video Coding (VVC) decoders can be twice as high as comparable High Efficiency Video Coding (HEVC) decoders.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
In previous research, it was shown that the software decoding energy demand of High Efficiency Video Coding (HEVC) can be reduced by 15$\%$ by using a decoding-energy-rate-distortion optimization algorithm.
no code implementations • 21 Sep 2022 • Matthias Kränzler, Christian Herglotz, André Kaup
We show that bit streams of the 360{\deg}, HDR, and fisheye video format can be estimated with a mean estimation error lower than 3. 88% if the setups have the same coding bit depth.
no code implementations • 21 Sep 2022 • Christian Herglotz, Geetha Ramasubbu, André Kaup
Recent research has shown that temporal downsampling of high-frame-rate sequences can be exploited to improve the rate-distortion performance in video coding.
no code implementations • 16 Sep 2022 • Frank Sippel, Jürgen Seiler, André Kaup
Therefore, multispectral cameras with wide-band filters are used, which are much cheaper and are often able to capture videos.
no code implementations • 16 Sep 2022 • Frank Sippel, Jürgen Seiler, André Kaup
In this paper we introduce a novel fast binary search for optimal filter selection that guarantees a minimum distance metric between the different spectra to classify.
no code implementations • 16 Sep 2022 • Frank Sippel, Jürgen Seiler, André Kaup
In many image processing tasks it occurs that pixels or blocks of pixels are missing or lost in only some channels.
no code implementations • 16 Sep 2022 • Frank Sippel, Jürgen Seiler, Nils Genser, André Kaup
This novel estimation method is based on the guided filtering technique which preserves basic structures, while using spatial information to reduce the influence of noise.
no code implementations • 15 Sep 2022 • Andreas Spruck, Markus Jonscher, Jürgen Seiler, André Kaup
This proposed extension solves the problem of changing content within the area considered by the 3D-FSE, which is caused by motion within the sequence.
no code implementations • 20 Jul 2022 • Jürgen Seiler, Katrin Meisinger, André Kaup
Therefore the signal from the known samples is iteratively projected onto different basis functions in order to generate a model of the signal.
no code implementations • 20 Jul 2022 • Jürgen Seiler, Haricharan Lakshman, André Kaup
Within the scope of this contribution we propose a novel efficient spatio-temporal prediction algorithm for video coding.
no code implementations • 20 Jul 2022 • Jürgen Seiler, Thomas Richter, André Kaup
For this, the prediction is carried out in two steps.
no code implementations • 20 Jul 2022 • Jürgen Seiler, Susanne Schöll, Wolfgang Schnurrer, André Kaup
A problem often arising in video communication is the reconstruction of missing or distorted areas in a video sequence.
no code implementations • 14 Jul 2022 • Jürgen Seiler, André Kaup
The proposed adaptive prior allows for a very high reconstruction quality, yielding gains of up to 0. 6 dB PSNR over the fixed prior, independently of the density of the available samples.
no code implementations • 14 Jul 2022 • Jürgen Seiler, André Kaup
This contribution introduces a novel signal extrapolation algorithm and its application to image error concealment.
no code implementations • 14 Jul 2022 • Jürgen Seiler, André Kaup
In the past years, video communication has found its application in an increasing number of environments.
no code implementations • 8 Jul 2022 • Jürgen Seiler, André Kaup
The purpose of this contribution is to introduce a new method of signal prediction in video coding.
no code implementations • 8 Jul 2022 • Jürgen Seiler, André Kaup
To cope with this, error concealment can be applied on the distorted data at the receiver.
no code implementations • 8 Jul 2022 • Jürgen Seiler, Michael Schöberl, André Kaup
For this, Non-Local Means denoising is used which is extended by a spiral scan processing order and is improved by an adaptation step for taking the preliminary temporal extrapolation into account.
no code implementations • 6 Jul 2022 • Geetha Ramasubbu, André Kaup, Christian Herglotz
The global significance of energy consumption of video communication renders research on the energy need of video coding an important task.
no code implementations • 4 Jul 2022 • Jürgen Seiler, André Kaup
Since the basis functions are not orthogonal regarding the area of the known samples, the projection does not lead to the real portion a basis function has of the signal.
no code implementations • 4 Jul 2022 • Jürgen Seiler, André Kaup
In this contribution, a novel spatio-temporal prediction algorithm for video coding is introduced.
no code implementations • 4 Jul 2022 • Jürgen Seiler, André Kaup
The prediction step is a very important part of hybrid video codecs for effectively compressing video sequences.
no code implementations • 1 Jul 2022 • Jürgen Seiler, André Kaup
Although wireless and IP-based access to video content gives a new degree of freedom to the viewers, the risk of severe block losses caused by transmission errors is always present.
no code implementations • 1 Jul 2022 • Jürgen Seiler, André Kaup
In this contribution an optimized processing order is proposed for Frequency Selective Extrapolation, a powerful signal extrapolation algorithm.
no code implementations • 1 Jul 2022 • Jürgen Seiler, André Kaup
The proposed framework allows for the application of existing image signal extrapolation algorithms without the need to modify them for a parallel processing.
no code implementations • 27 Jun 2022 • Matthias Kränzler, Adam Wieckowski, Geetha Ramasubbu, Benjamin Bross, André Kaup, Detlev Marpe, Christian Herglotz
We show that encoding using our proposed coding tool profiles, the decoding energy efficiency is improved by over 25% with a bit rate increase of less than 5% with respect to standard encoding.
no code implementations • 24 Jun 2022 • Christian Herglotz, Nils Genser, André Kaup
These savings are more than twice as high as savings obtained using competing methods from literature.
no code implementations • 23 May 2022 • Ján Koloda, Jürgen Seiler, Antonio M. Peinado, André Kaup
In this paper, we propose a novel scalable spatial error concealment algorithm that aims at obtaining high quality reconstructions with reduced computational burden.
no code implementations • 23 May 2022 • Ján Koloda, Jürgen Seiler, André Kaup
Digital images are commonly represented as regular 2D arrays, so pixels are organized in form of a matrix addressed by integers.
no code implementations • 20 May 2022 • Ján Koloda, Jürgen Seiler, André Kaup
This paper presents a novel method for the reconstruction of images from samples located at non-integer positions, called mesh.
no code implementations • 16 May 2022 • Ján Koloda, Jürgen Seiler, André Kaup, Victoria Sánchez, Antonio M. Peinado
The purpose of signal extrapolation is to estimate unknown signal parts from known samples.
no code implementations • 13 May 2022 • Kristian Fischer, Markus Hofbauer, Christopher Kuhn, Eckehard Steinbach, André Kaup
To mitigate this problem, we propose an evaluation method based on pseudo ground-truth data from the field of semantic segmentation to the evaluation of video coding for machines.
no code implementations • 13 May 2022 • Kristian Fischer, Christian Blum, Christian Herglotz, André Kaup
Deep neural object detection or segmentation networks are commonly trained with pristine, uncompressed data.
no code implementations • 13 May 2022 • Kristian Fischer, Christian Forsch, Christian Herglotz, André Kaup
Video and image coding for machines (VCM) is an emerging field that aims to develop compression methods resulting in optimal bitstreams when the decoded frames are analyzed by a neural network.
1 code implementation • 5 May 2022 • Simon Grosche, Andy Regensky, Alexander Sinn, Jürgen Seiler, André Kaup
Recently, non-regular three-quarter sampling has shown to deliver an increased image quality of image sensors by using differently oriented L-shaped pixels compared to the same number of square pixels.
no code implementations • 3 May 2022 • Viktoria Heimann, Andreas Spruck, André Kaup
The demand for high-resolution point clouds has increased throughout the last years.
no code implementations • 27 Apr 2022 • Jürgen Seiler, Markus Jonscher, Michael Schöberl, André Kaup
Even though image signals are typically defined on a regular two-dimensional grid, there also exist many scenarios where this is not the case and the amplitude of the image signal only is available for a non-regular subset of pixel positions.
no code implementations • 27 Apr 2022 • Jürgen Seiler, Markus Jonscher, Thomas Ussmueller, André Kaup
In this paper, we propose a novel image sensor layout which allows for the acquisition of images at a higher resolution and improved quality.
no code implementations • 27 Apr 2022 • Jürgen Seiler, André Kaup
The model generation is conducted by an enhanced version of Three-Dimensional Frequency Selective Extrapolation, an existing error concealment algorithm.
no code implementations • 27 Apr 2022 • Jürgen Seiler, André Kaup
Within the scope of this contribution, a novel efficient solution for Selective Extrapolation is presented for utilization with arbitrary basis functions.
no code implementations • 27 Apr 2022 • Jürgen Seiler, André Kaup
Within the scope of this contribution, we introduce the complex-valued Frequency Selective Extrapolation for fast image and video signal extrapolation.
no code implementations • 21 Apr 2022 • Christian Herglotz, Yongjun Wen, Bowen Dai, Matthias Kränzler, André Kaup
In this paper we show that a small amount of bit stream features can be used to accurately estimate the energy consumption of state-of-the-art software and hardware accelerated decoder implementations for four different video codecs.
no code implementations • 7 Apr 2022 • Markus Jonscher, Jürgen Seiler, Daniela Lanz, Michael Schöberl, Michel Bätz, André Kaup
The main benefit of the proposed dynamic readout is that for each frame, different sampling points are available which is advantageous since this information can significantly enhance the reconstruction quality of the proposed reconstruction algorithm.
no code implementations • 7 Apr 2022 • Markus Jonscher, Jürgen Seiler, André Kaup
Hence, a new texture-dependent approach for frequency selective reconstruction is introduced that distributes the number of iterations depending on the texture of the regions to be reconstructed.
no code implementations • 7 Apr 2022 • Markus Jonscher, Karina Jaskolka, Jürgen Seiler, André Kaup
In this paper, a new recursive multi-frame reconstruction approach is proposed in order to further increase the reconstruction quality.
no code implementations • 7 Apr 2022 • Markus Jonscher, Jürgen Seiler, Thomas Richter, Michel Bätz, André Kaup
Recently, it has been shown that by covering a low resolution sensor with a non-regular sampling mask and by using an efficient algorithm for image reconstruction, a high resolution image can be obtained.
no code implementations • 7 Apr 2022 • Markus Jonscher, Jürgen Seiler, Michel Bätz, Thomas Richter, Wolfgang Schnurrer, André Kaup
Recently, it has been shown that a high resolution image can be obtained without the usage of a high resolution sensor.
no code implementations • 7 Apr 2022 • Markus Jonscher, Jürgen Seiler, Thomas Richter, André Kaup
Recently, it has been shown that it is possible to obtain a high resolution image by covering a low resolution sensor with a non-regular sampling mask.
no code implementations • 7 Apr 2022 • Markus Jonscher, Jürgen Seiler, André Kaup
The reconstruction of clipped speech signals is an important task in audio signal processing to achieve an enhanced audio quality for further processing.
no code implementations • 2 Apr 2022 • Ming Zhao, Bowen An, Yongpeng Wu, Huynh Van Luong, André Kaup
In this paper, a robust feature point matching algorithm called Recovery and Filtering Vertex Trichotomy Matching (RFVTM) is proposed to remove outliers and retain sufficient inliers for remote sensing images.
no code implementations • 2 Apr 2022 • Ming Zhao, Yongpeng Wu, Shengda Pan, Fan Zhou, Bowen An, André Kaup
This new approach is designed to address the problems associated with the registration of images with affine deformations and inconsistent content, such as remote sensing images with different spectral content or noise interference, or map images with inconsistent annotations.
no code implementations • 17 Mar 2022 • Viktoria Heimann, Andreas Spruck, André Kaup
Secondly, we propose to apply a novel Frequency-Selective Mesh-to-Mesh Resampling (FSMMR) technique for the interpolation of the points in 2D.
no code implementations • 17 Mar 2022 • Simon Grosche, Jürgen Seiler, André Kaup
Altogether, we are able to significantly increase the reconstruction quality by + 1. 01 dB compared to the state-of-the-art recursive reconstruction method using a fixed mask.
1 code implementation • 17 Mar 2022 • Simon Grosche, Fabian Brand, André Kaup
Altogether, using a three-quarter sampling sensor with our novel neural network layout, the image quality in terms of PSNR for the Urban100 dataset can be increased by 2. 96 dB compared to the state-of-the-art approach.
no code implementations • 15 Mar 2022 • Viktoria Heimann, Nils Genser, André Kaup
A state-of-the-art high quality model-based resampling technique is frequency-selective mesh-to-grid resampling which requires pre-estimation of key points.
no code implementations • 11 Mar 2022 • Kristian Fischer, Felix Fleckenstein, Christian Herglotz, André Kaup
Saliency-driven image and video coding for humans has gained importance in the recent past.
no code implementations • 11 Mar 2022 • Kristian Fischer, Fabian Brand, Christian Herglotz, André Kaup
In this paper, we propose a standard-compliant feature-based RDO (FRDO) that is designed to increase the coding performance, when the decoded frame is analyzed by a neural network in a video coding for machine scenario.
no code implementations • 11 Mar 2022 • Kristian Fischer, Christian Herglotz, André Kaup
Classical video coding for satisfying humans as the final user is a widely investigated field of studies for visual content, and common video codecs are all optimized for the human visual system (HVS).
no code implementations • 3 Mar 2022 • Christian Herglotz, Jürgen Seiler, André Kaup, Arne Hendricks, Marc Reichenbach, Dietmar Fey
In recent years, due to a higher demand for portable devices, which provide restricted amounts of processing capacity and battery power, the need for energy and time efficient hard- and software solutions has increased.
no code implementations • 3 Mar 2022 • Christian Herglotz, Dominic Springer, Andrea Eichenseer, André Kaup
Battery life is one of the major limitations to mobile device use, which makes research on energy efficient soft- and hardware an important task.
no code implementations • 3 Mar 2022 • Christian Herglotz, André Kaup
This paper presents a novel algorithm that aims at minimizing the required decoding energy by exploiting a general energy model for HEVC-decoder solutions.
no code implementations • 3 Mar 2022 • Christian Herglotz, Elisabeth Walencik, André Kaup
This paper presents a method to accurately estimate the required decoding energy for a given HEVC software decoding solution.
no code implementations • 3 Mar 2022 • Christian Herglotz, Rafael Rosales, Michael Glass, Jürgen Teich, André Kaup
Finding the best possible encoding decisions for compressing a video sequence is a highly complex problem.
no code implementations • 2 Mar 2022 • Christian Herglotz, Andreas Heindel, André Kaup
Finally, measurements of the software decoding process for HEVC-coded bit streams are performed.
no code implementations • 1 Mar 2022 • Christian Herglotz, Dominic Springer, Marc Reichenbach, Benno Stabernack, André Kaup
To show the modeling capabilities in general, we test the estimation performance for different decoding software and hardware solutions, where we find that the proposed model outperforms the models from literature by reaching frame-wise mean estimation errors of less than 7% for software and less than 15% for hardware based systems.
no code implementations • 1 Mar 2022 • Simon Grosche, Jürgen Seiler, André Kaup
Non-regular sampling can reduce aliasing at the expense of noise.
no code implementations • 1 Mar 2022 • Simon Grosche, Jürgen Seiler, André Kaup
Even though image signals are typically acquired on a regular two dimensional grid, there exist many scenarios where non-regular sampling is possible.
no code implementations • 1 Mar 2022 • Simon Grosche, Kristian Fischer, Fabian Brand, Jürgen Seiler, André Kaup
Quarter sampling is a novel sensor concept that enables the acquisition of higher resolution images without increasing the number of pixels.
no code implementations • 28 Feb 2022 • Andy Regensky, Christian Herglotz, André Kaup
However, the approach does not consider the large field of view of fisheye lenses that requires the consideration of different motion planes in 3D space.
1 code implementation • 28 Feb 2022 • Andy Regensky, Simon Grosche, Jürgen Seiler, André Kaup
Frequency Selective Reconstruction (FSR) is a state-of-the-art algorithm for solving diverse image reconstruction tasks, where a subset of pixel values in the image is missing.
no code implementations • 25 Feb 2022 • Christian Herglotz, Matthias Kränzler, Ruben Mons, André Kaup
For 20 years, the gold standard to evaluate the performance of video codecs is to calculate average differences between ratedistortion curves, also called the "Bj{\o}ntegaard Delta".
no code implementations • 15 Feb 2022 • Fabian Brand, Christian Herglotz, André Kaup
There are many tasks within video compression which require fast bit rate estimation.
no code implementations • 7 Feb 2022 • Andy Regensky, Christian Herglotz, André Kaup
Based on the known projection format of the video, MPA allows to perform inter prediction on different motion planes in 3D space instead of having to work on the - in theory arbitrarily mapped - 2D image representation directly.
no code implementations • 5 Jan 2022 • Fabian Brand, Kristian Fischer, Alexander Kopte, André Kaup
Even though rate-distortion optimization is a crucial part of traditional image and video compression, not many approaches exist which transfer this concept to end-to-end-trained image compression.
1 code implementation • 15 Dec 2021 • Kristian Fischer, Fabian Brand, André Kaup
Compared to the standard VVC, 41. 4% of bitrate are saved by this method for Mask R-CNN as analysis network on the uncompressed Cityscapes dataset.
no code implementations • 15 Dec 2021 • Fabian Brand, Jürgen Seiler, André Kaup
Motion compensated inter prediction is a common component of all video coders.
no code implementations • 23 Nov 2021 • Matthias Kränzler, Christian Herglotz, André Kaup
IP traffic has increased significantly in recent years, and it is expected that this progress will continue.
no code implementations • CVPR 2023 • Simon Grosche, Andy Regensky, Jürgen Seiler, André Kaup
Next, we investigate the reconstruction quality using tetromino pixels for the first time in literature.
no code implementations • 17 Sep 2018 • Thomas Köhler, Michel Bätz, Farzad Naderi, André Kaup, Andreas Maier, Christian Riess
One interesting result is that top-performing methods on simulated data may be surpassed by others on real data.
no code implementations • 8 Feb 2018 • Huynh Van Luong, Nikos Deligiannis, Søren Forchhammer, André Kaup
The proposed decomposition solves an $n$-$\ell_1$ cluster-weighted minimization to decompose a sequence of frames (or vectors), into sparse and low-rank components, from compressive measurements.
no code implementations • 8 Sep 2017 • Thomas Köhler, Michel Bätz, Farzad Naderi, André Kaup, Andreas K. Maier, Christian Riess
Therefore, current studies are either evaluated 1) on simulated data or 2) on real data without a pixel-wise ground truth.
no code implementations • 18 Jul 2016 • Huynh Van Luong, Nikos Deligiannis, Søren Forchhammer, André Kaup
In support of applications involving multiview sources in distributed object recognition using lightweight cameras, we propose a new method for the distributed coding of sparse sources as visual descriptor histograms extracted from multiview images.
no code implementations • 22 May 2016 • Huynh Van Luong, Jürgen Seiler, André Kaup, Søren Forchhammer
This two-level optimization leads the proposed reconstruction algorithm with multiple SI using adaptive weights (RAMSIA) to robustly exploit the multiple SIs with different qualities.