Quality enhancement in mobile terrestrially received analog and digital video signals [Elektronische Ressource] = Qualitätsverbesserung von mobil terrestrisch empfangenen analogen und digitalen Videosignalen / vorgelegt von Markus Hans Friebe

Informations

• Publié par: friedrich-alexander-universitat_erlangen-nurnberg
• Publié le: 01 janvier 2007
• Nombre de lectures: 13
• Langue: English
• Poids de l'ouvrage: 16 Mo

Extrait

Quality Enhancement in Mobile Terrestrially
Received Analog and Digital Video Signals
Qualit¨atsverbesserung von mobil terrestrisch empfangenen
analogen und digitalen Videosignalen
Der Technischen Fakult¨at der
Friedrich-Alexander-Universit¨at Erlangen-Nu¨rnberg
zur Erlangung des Grades
Doktor-Ingenieur
vorgelegt von
Markus Hans Friebe
Erlangen, 2007Als Dissertation genehmigt von
der Technischen Fakult¨at der
Friedrich-Alexander-Universit¨at
Erlangen-Nu¨rnberg
Tag der Einreichung: 12.02.2007
Tag der Promotion: 11.05.2007
Dekan: Prof. Dr.-Ing. Alfred Leipertz
Berichterstatter: Prof. Dr.-Ing. Andr´e Kaup,
University of Erlangen-Nuremberg, Germany
Prof. Sanjit K. Mitra Ph.D.,
University of California Santa Barbara, CA, USAAcknowledgments
I would especially like to thank Prof. Dr.-Ing. Andr´e Kaup of the Friedrich-Alexander-
University in Erlangen, Germany, for giving me the opportunity working in his research
group and so many inspiring discussions.
Further, I am indebted to Prof. Sanjit K. Mitra Ph.D. of the University of California
in Santa Barbara, USA, for his interest in my work, reviewing my thesis, and taking the
long way from California to participate in the defence of my thesis. I would like to thank
the Lear Corporation in Kronach, Germany, for funding my research work and so many
useful discussions.
Without denoting names, I would like to thank all of my former colleges for the very
friendly atmosphere, which makes my stay very enjoyable. Many thanks to my students
MirjaKu¨hlewindandDanielWilhelmfortheirprogramminghelpandtheBavariaCalifor-
nia Technology Center (BaCaTeC) for financial support to the research collaboration on
“error concealment for erroneously received compressed video data” between the Univer-
sity of California in Santa Barbara and the Friedrich-Alexander-University in Erlangen.
Additionally, I am very grateful to Dr.-Ing. Bernd Hardung for proof-reading my
thesis and numerous discussions.
Finally, my deepest thanks belong to Carolin for every day we spend together.v
Contents
1 Introduction 1
2 Analysis of Mobile Received Analog Video Signals 5
2.1 Basics of Analog Video Signals. . . . . . . . . . . . . . . . . . . . . . . . . 5
2.2 Mobile Terrestrial Reception of Analog Video Signals . . . . . . . . . . . . 6
2.3 Classification of Image Distortions . . . . . . . . . . . . . . . . . . . . . . . 9
2.3.1 Impulse Noise . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.3.2 Intensity Flicker . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.3.3 Ghost Images . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.3.4 Additive Noise . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.3.5 Interlacing Artifacts . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3 Related Work to Reduce Image Distortions in Analog Video Signals 15
3.1 Impulse Noise . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.1.1 Median Filter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3.1.2 Signal-Dependent Rank Ordered Mean Filter . . . . . . . . . . . . . 17
3.2 Ghost Images . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
3.2.1 Ghost Cancellation with Reference Signals . . . . . . . . . . . . . . 20
3.2.2 Blind Ghost Cancellation . . . . . . . . . . . . . . . . . . . . . . . . 20
3.3 Additive Noise. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
3.3.1 Bilateral Filter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
3.3.2 Best-Neighbor Filter . . . . . . . . . . . . . . . . . . . . . . . . . . 24
3.3.3 Adaptive K-Nearest-Neighbor Filter . . . . . . . . . . . . . . . . . . 26
3.3.4 Adaptive Multiple Class Averaging Filter . . . . . . . . . . . . . . . 27
3.4 Interlacing Artifacts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
4 Reduction of Image Distortions in Analog Video Signals 31
4.1 Impulse Noise . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
4.1.1 Field Selective Interpolation of Field Information . . . . . . . . . . 32
4.1.2 Line Selective Interpolation of Field Information Using Line Mean
Values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34vi Contents
4.1.3 Line Selective Interpolation of Field Information using Line Mean
Values and Standard Deviations . . . . . . . . . . . . . . . . . . . . 38
4.2 Intensity Flicker . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
4.3 Additive Noise. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.3.1 Two Classes Gauss-Weighting Filter. . . . . . . . . . . . . . . . . . 44
4.3.2 Gauss-Weighting Filter . . . . . . . . . . . . . . . . . . . . . . . . . 49
4.3.3 Comparison of Noise Reduction Methods . . . . . . . . . . . . . . . 50
4.4 System for Quality Enhancement of Analog Video Signals. . . . . . . . . . 55
5 Analysis of Mobile Received Digital Video Signals 63
5.1 Basics of Digital Video Coding . . . . . . . . . . . . . . . . . . . . . . . . . 63
5.2 Mobile Terrestrial Reception of Digital Video Signals . . . . . . . . . . . . 65
5.3 Classification of Image Distortions . . . . . . . . . . . . . . . . . . . . . . . 65
5.3.1 Blurring Artifacts . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
5.3.2 Displacement Artifacts . . . . . . . . . . . . . . . . . . . . . . . . . 66
6 Related Work to Reduce Image Distortions in Digital Video Signals 69
6.1 Spatial Error Concealment . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
6.1.1 Maximally Smooth Recovery . . . . . . . . . . . . . . . . . . . . . . 70
6.1.2 Fast DCT-Based Spatial Domain Interpolation . . . . . . . . . . . . 71
6.1.3 Bilinear Interpolation . . . . . . . . . . . . . . . . . . . . . . . . . . 71
6.1.4 Frequency Selective Signal Extrapolation . . . . . . . . . . . . . . . 74
6.2 Temporal Error Concealment . . . . . . . . . . . . . . . . . . . . . . . . . 76
6.2.1 Temporal Replacement . . . . . . . . . . . . . . . . . . . . . . . . . 77
6.2.2 Boundary Matching Algorithm . . . . . . . . . . . . . . . . . . . . 78
6.2.3 Decoder Motion Vector Estimation . . . . . . . . . . . . . . . . . . 81
6.2.4 Recursive Block-Matching Algorithm . . . . . . . . . . . . . . . . . 83
6.3 Bi-Temporal Error Concealment . . . . . . . . . . . . . . . . . . . . . . . . 87
6.3.1 Decoder Motion Vector Estimation Bidirectional . . . . . . . . . . . 88
6.3.2 Motion Compensated Macroblock Interpolation . . . . . . . . . . . 88
6.4 Spatio-Temporal Error Concealment . . . . . . . . . . . . . . . . . . . . . 91
6.4.1 Content-Based Adaptive Spatio-Temporal Method . . . . . . . . . . 91
7 Reduction of Image Distortions in Digital Video Signals 93
7.1 Spatio-Temporal Error Concealment . . . . . . . . . . . . . . . . . . . . . 93
7.1.1 3D-Deblocking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
7.1.2 Spatio-Temporal Fading Scheme . . . . . . . . . . . . . . . . . . . . 98
7.1.3 Fast Motion Vector Estimation within Spatio-Temporal
Fading Scheme . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
7.2 Spatio-Bi-Temporal Error Concealment . . . . . . . . . . . . . . . . . . . . 104Contents vii
7.2.1 Spatio-Bi-Temporal Fading Scheme . . . . . . . . . . . . . . . . . . 104
7.2.2 Fast Motion Vector Estimation within Spatio-Bi-Temporal Fading
Scheme . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
7.3 Comparison of Error Concealment for Uncompressed Video Frames . . . . 111
7.4 Comparison of Error Concealment for Compressed Video Frames . . . . . . 117
7.4.1 Predictive-coded Frames . . . . . . . . . . . . . . . . . . . . . . . . 119
7.4.2 Intra-coded Frames . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
7.4.3 Bidirectional-coded Frames. . . . . . . . . . . . . . . . . . . . . . . 123
7.5 Comparison of Computational Complexity . . . . . . . . . . . . . . . . . . 128
8 Summary and Conclusions 131
A Simulation System 135
B Abbreviations 137
C Notations 139
D Titel, Inhaltsverzeichnis, Einleitung und Zusammenfassung 143
D.1 Titel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
D.2 Inhaltsverzeichnis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
D.3 Einleitung . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146
D.4 Zusammenfassung und Schlussfolgerungen . . . . . . . . . . . . . . . . . . 149
Bibliography 152viii Contents1
1 Introduction
Automobiles of the upper and middle class make more and more use of multimedia sys-
tems. Besides radio reception, the demand for mobile terrestrial analog and digital TV
will increase in future. TV receivers, which are able to receive both analog and digital
TV, are also called hybrid TV receivers. Recent TV tuners use many hardware fea-
tures like selection or maximum ratio combining of different antenna signals to establish
an undisturbed mobile reception. However, through the mobile channel, there is still a
large amount of visible artifacts. These artifacts or image distortions are very annoy-
ing for human perception. The aim of this work is to reduce image distortions with a
video post-processing unit in order to suppress many of the appearing image distortions.
Additionally, in the mobile scenario less computational power