Knowledge Discovery in Big Data from Astronomy and Earth Observation: Astrogeoinformatics bridges the gap between astronomy and geoscience in the context of applications, techniques and key principles of big data. Machine learning and parallel computing are increasingly becoming cross-disciplinary as the phenomena of Big Data is becoming common place. This book provides insight into the common workflows and data science tools used for big data in astronomy and geoscience. After establishing similarity in data gathering, pre-processing and handling, the data science aspects are illustrated in the context of both fields. Software, hardware and algorithms of big data are addressed.
Finally, the book offers insight into the emerging science which combines data and expertise from both fields in studying the effect of cosmos on the earth and its inhabitants.
- Addresses both astronomy and geosciences in parallel, from a big data perspective
- Includes introductory information, key principles, applications and the latest techniques
- Well-supported by computing and information science-oriented chapters to introduce the necessary knowledge in these fields
|
|
vii | |
A Word From The Big-Sky-Earth Chair |
|
xi | |
Preface |
|
xiii | |
Acknowledgments |
|
xvii | |
|
|
|
1 Methodologies for Knowledge Discovery Processes in Context of AstroGeolnformatics |
|
|
7 | (20) |
|
|
|
|
2 Historical Background of Big Data in Astro and Geo Context |
|
|
27 | (10) |
|
|
|
|
3 AstroGeoInformatics: From Data Acquisition to Further Application |
|
|
37 | (2) |
|
|
4 Synergy in Astronomy and Geosciences |
|
|
39 | (18) |
|
|
|
5 Surveys, Catalogues, Databases, and Archives of Astronomical Data |
|
|
57 | (46) |
|
|
|
|
|
|
|
6 Surveys, Catalogues, Databases/Archives, and State-of-the-Art Methods for Geoscience Data Processing |
|
|
103 | |
|
|
|
|
|
7 High-Performance Techniques for Big Data Processing |
|
|
137 | (22) |
|
|
|
8 Query Processing and Access Methods for Big Astro and Geo Databases |
|
|
159 | (14) |
|
|
|
|
|
9 Real-Time Stream Processing in Astronomy |
|
|
173 | (10) |
|
|
|
|
|
|
183 | (14) |
|
|
11 Advanced Time Series Analysis of Generally Irregularly Spaced Signals: Beyond the Oversimplified Methods |
|
|
197 | (28) |
|
|
12 Learning in Big Data: Introduction to Machine Learning |
|
|
225 | (26) |
|
|
|
13 Deep Learning -- an Opportunity and a Challenge for Geo- and Astrophysics |
|
|
251 | (16) |
|
|
|
14 Astro- and Geoinformatics -- visually Guided Classification of Time Series Data |
|
|
267 | (16) |
|
|
|
|
|
|
|
15 When Evolutionary Computing Meets Astro- and Geoinformatics |
|
|
283 | (24) |
|
|
|
|
|
16 Multiwavelength Extragalactic Surveys: Examples of Data Mining |
|
|
307 | (18) |
|
|
|
|
|
|
17 Applications of Big Data in Astronomy and Geosciences: Algorithms for Photographic Images Processing and Error Elimination |
|
|
325 | (6) |
|
|
|
18 Big Astronomical Datasets and Discovery of New Celestial Bodies in the Solar System in Automated Mode by the CoLiTec Software |
|
|
331 | (16) |
|
|
|
19 Big Data for the Magnetic Field Variations in Solar-Terrestrial Physics and Their Wavelet Analysis |
|
|
347 | (24) |
|
|
|
|
20 International Database of Neutron Monitor Measurements: Development and Applications |
|
|
371 | (14) |
|
|
|
|
21 Monitoring the Earth Ionosphere by Listening to GPS Satellites |
|
|
385 | (20) |
|
|
|
22 Exploitation of Big Real-Time GNSS Databases for Weather Prediction |
|
|
405 | (14) |
|
|
|
23 Application of Databases Collected in Ionospheric Observations by VLF/LF Radio Signals |
|
|
419 | (16) |
|
|
24 Influence on Life Applications of a Federated Astro-Geo Database |
|
|
435 | (10) |
|
Index |
|
445 | |
Petr koda has been involved in astroinformatics and has a long-term experience in using and lecturing the astronomical Virtual observatory. One of the proposers of COST BigSkyEarth Action and its MC member. BigSkyEarth is the working group behind the idea of the book and a conference about the same topic. Fathalrahman Adam has good understanding of classical machine learning and new concepts, along with hands-on experience and published papers. He is involved in large scale applications using satellite data for earth observation, mainly multi-spectral data. He is a member of BigSkyEarth COST Action.