Optical Satellite Data Compression and Implementation
Book Details :
LanguageEnglish
Pages410
FormatPDF
Size11.8 MB


Optical Satellite Data Compression and Implementation



Download PDF of Optical Satellite Data Compression and Implementation for free.


The Author of Optical Satellite Data Compression and Implementation 

Shen-En Qian is the editor of Optical Satellite Data Compression and Implementation PDF Book

Main Contents of Optical Satellite Date Compression and Implementation PDF Book


  • Needs for Data Compression and Image Quality Metrics
  • Lossless Satellite Data Compression
  • International Standards for Spacecraft Data Compression
  • Vector Quantization Data Compression
  • Onboard Near-Lossless Data Compression Techniques
  • Optimizing the Performance of Onboard Data Compression
  • Data Compression Engines aboard a Satellite
  • User Acceptability Study of Satellite Data Compression
  • Hyperspectral Image Browser for Online Satellite Data Analysis and Distribution

Preface to Optical Satellite Data Compression and Implementation by Shen-En Qian


Satellite data compression has been an important subject since the beginning of satellites in orbit, and it has become an even more active research topic. (Optical Satellite Data Compression by Shen-En Qian)

Following technological advancements, the trend of new satellites has led to an increase in spatial, spectral, and radiometric resolution, an extension in wavelength range, and a widening of the ground swath to better serve the needs of the user community and decision-makers.

Data compression is often used as a sound solution to overcome the challenges of handling a tremendous amount of data.

I have been working in this area since I was pursing my Ph. D. thesis almost 30 years ago. (Optical Satellite Data Compression by Shen-En Qian)

Over the last two decades, I—was a senior research scientist and technical authority with the Canadian Space Agency—have led and carried out research and development of innovative data compression technology for optical satellites in collaboration with my colleagues at the agency, other government departments, my postdoctoral visiting fellows, internship students, and engineers at Canadian space industry.

I invented and patented two series of near-lossless satellite data compression techniques and led the Canadian industry teams who implemented the techniques and built the onboard near-lossless compressors. (Optical Satellite Data Compression by Shen-En Qian)

I also led a multidisciplinary user team to assess the impact of the near-lossless compression techniques on ultimate satellite data applications.

As the representative of Canada, I am an active member of the CCSDS working group for developing international data-compression standards for satellite data systems. (Optical Satellite Data Compression by Shen-En Qian)

Three international satellite data compression standards have been developed by the working group and published by the International Organization for Standardization (ISO).

In FROODERUDWLQJ ZLWK H[SHUWV LQ WKLV DUHD LQ WKH ZRUOG, KDYH FR FKDLUHG DQ 63,( conference on satellite data compression, communication, and signal processing since 2005.

I have published over sixty papers and currently hold six U. S. patents, two European patents, and several pending patents in the subjects of satellite data compression and implementation.

I feel that I have acquired sufficient knowledge and accumulated plenty of experience in this area, and it is worth the effort to systematically organize them and put them into a book.

This Optical Satellite Data Compression by Shen-En Qian PDF book is my attempt to provide an end-to-end treatment of optical satellite data compression and implementation based on 30 years of firsthand experience and research outcomes.

(It is a companion text to my PDF book Optical Satellite Signal Processing and Enhancement, published by SPIE Press.) (Optical Satellite Data Compression by Shen-En Qian)

The contents of the book consist of nine chapters that cover a wide range of topics in this field. It serves as an introduction for readers who are willing to learn the basics and the evolution of data compression, and a guide for those working on onboard and ground satellite data compression, data handling, and manipulation, and deployment of data-compression subsystems.

The material is written to provide clear definitions and precise descriptions for advanced researchers and expert practitioners as well as for beginners.

Chapters open with a brief introduction of the subject matter, followed by a review of previous approaches and their shortcomings, a presentation of recent techniques with improved performance, and finally a report on experimental results in order to assess their effectiveness and to provide conclusions.


Chapter 1 is the introduction to the PDF book that describes the rationale and needs for satellite data compression and introduces a set of image quality metrics for assessing compressed satellite images.

Chapter 2 presents a review of satellite lossless-data-compression techniques, considering both prediction-based and transform-based methods. (Optical Satellite Data Compression by Shen-En Qian)

Chapter 3 summarizes three international satellite-data-compression standards developed by CCSDS from the perspective of applying the standards.

Chapter 4 describes vector quantization (VQ) based data-compression techniques that I have developed for compressing hyperspectral data.

The focus of the research was to significantly reduce the computational complexity of conventional VQ algorithms in order for them to effectively compress hyperspectral datacubes.

Many innovative yet practical solutions have been developed, including two of my granted patents: Successive Approximation Multi-stage Vector Quantization (SAMVQ) and Hierarchical Self-Organizing Cluster Vector Quantization (HSOCVQ).

Chapter 5 describes how both of these techniques solve the blocking effect when applied to compress continuous data flow generated aboard satellites and how they restrict the compression error to a level lower than that of the intrinsic noise of the original data to achieve so-called near-lossless compression.

Chapter 6 addresses the optimization and implementation aspects of onboard data compression; aspects include the effect of anomalies of input data on compression performance, the location in the onboard data processing chain where the compressor should be deployed, and the techniques to enhance error resilience in the data downlink transmission channel.

Chapter 7 describes the hardware implementation of compression engines and onboard compressors that are based on SAMVQ and HSOCVQ.

Chapter 8 reports a multidisciplinary user-acceptance study that assessed the impact of the compression techniques on various hyperspectral data applications to address the users’ concern about possible information loss due to the lossy compression nature of SAMVQ and HSOCVQ.

Chapter 9 describes the Hyperspectral Image Browser (HIBR) system, which is capable of remotely displaying large hyperspectral datacubes via the Internet and of quickly processing the datacubes directly on the compressed form for users to identify the interested data, whose richness comes mostly from the spectral information.

There are many people I would like to thank for their contributions to the works included in this Optical Satellite Data Compression by Shen-En Qian PDF book.

I would like to thank the Canadian Space Agency, where I have been working for the last 20 years; my colleagues Allan Hollinger, Martin Bergeron, Michael Maszkiewicz, Ian Cunningham, and Davinder Manak for their participation in data compression projects; my postdoctoral visiting fellows Pirouz Zarrinkhat and Charles Searle; and over forty intern students who have each left their mark.

I would like to thank Robert Neville (retired), Karl Staenz (now at the University of Lethbridge), and Lixin Sun at the Canada Centre for Remote Sensing for collaborating on the Canadian hyperspectral program;

Josée Lévesque and Jean-Pierre Ardouin at the Defence Research and Development Canada for their collaboration on assessing the impact of data compression. (Optical Satellite Data Compression by Shen-En Qian)

I thank David Goodenough at the Pacific Forestry Centre; John Miller and Baoxin Hu at York University for providing datasets and for actively collaborating on the data-compression user acceptability study;

and Bormin Huang of the Cooperative Institute for Meteorological Satellite Studies at the University of Wisconsin-Madison for his discussion on satellite data compression.

I would also like to thank the participants in the user acceptability study: Andrew Dyk at the Pacific Forestry Centre; Jing Chen at the University of Toronto; Harold Zwick, Dan Williams, Chris Nadeau, and Gordon Jolly at MacDonald Dettwiler Associates; and Benoit Rivard and Jilu Feng at the University of Alberta. (Optical Satellite Data Compression by Shen-En Qian)

I thank Luc Gagnon, William Harvey, Bob Barrette, and Colin Black at MacDonald Dettwiler Associates (former EMS Technologies) for the development and fabrication of onboard compressor prototypes; and Melanie Dutkiewicz and Herbal Tsang for the development of a hyperspectral browser.

I thank Valec Szwarc and Mario Caron at the Communication Research Centre (Canada) for discussions on enhancing resilience to bit errors of compressed data in the downlink channel; and Peter Oswald and Ron Buckingham for their discussion on onboard data compression.

Related Free eBooks
Design of Integrated Circuits for Optical Communications
Satellite Communications Systems Design Principles

I would also like to thank Penshu Yeh at the NASA Goddard Space Flight Center, Aaron Kiely at the Jet Propulsion Laboratory, Carole Thiebaut and Gilles Moury at the French Space Agency (CNES), and Raffaele Vitulli at the European Space Agency for the collaboration within the CCSDS in developing international spacecraft-data standards and for their contributions to the CCSDS work included in this Optical Satellite Data Compression by Shen-En Qian PDF book. (Optical Satellite Data Compression by Shen-En Qian)

I would also like to thank the three anonymous manuscript reviewers for their tireless work and strong endorsement of this Optical Satellite Data Compression by Shen-En Qian PDF book,

their careful and meticulous chapter-by-chapter review on behalf of SPIE Press, and their detailed comments leading to the improvement and final results of the PDF book in its current form.

Many thanks as well to Tim Lamkins, Scott McNeill, and Dara Burrows at SPIE Press for turning my manuscript into this optical Satellite Data Compression by Shen-En Qian PDF book. (Optical Satellite Data Compression by Shen-En Qian)

Finally, I would like to thank my wife Nancy and daughter Cynthia for their help and support. They provided great encouragement and assistance during the period I wrote this Optical Satellite Data Compression by Shen-En Qian PDF book

The credit of this Optical Satellite Data Compression by Shen-En Qian PDF book should go to them. (Optical Satellite Data Compression by Shen-En Qian)


Download Optical Satellite Data Compression and implementation by Shen-En Qian easily in PDF format for free.