A procedure to import seismological data into the Ophidia big data analytics framework
Author(s)
Language
English
Obiettivo Specifico
3IT. Calcolo scientifico
Status
Published
JCR Journal
N/A or not JCR
Peer review journal
Yes
Journal
Issue/vol(year)
410/(2019)
Publisher
Istituto Nazionale di Geofisica e Vulcanologia
Pages (printed)
1-22
Date Issued
September 18, 2019
Alternative Location
Abstract
The term Big Data identifies large data sets that cannot be managed with traditional processing
software. Volume, Variety and Velocity are properties used to classify Big Data. Velocity, the most
relevant property, refers to high speed of data acquisition and processing. Management of Big
Data, and particularly Velocity, has become an open issue for scientific communities. The EC project INDIGO-Datacloud
was conceived to tackle some of the Big Data challenges that scientific communities are facing. In the context of INDIGO-Datacloud we defined a case study in which one of the goals was the improvement of processing performance on seismological data. Starting with a practical case study, we identified, as possible software solution, Ophidia, a big data
analytics framework. The first step to exploit the framework functionalities required the import
of the seismological data in Ophidia. For this purpose, we designed and implemented a software
module that enables the import of seismological data in SAC format. As a second step, we tested
the capabilities of Ophidia through a performance test to evaluate the framework potential.
software. Volume, Variety and Velocity are properties used to classify Big Data. Velocity, the most
relevant property, refers to high speed of data acquisition and processing. Management of Big
Data, and particularly Velocity, has become an open issue for scientific communities. The EC project INDIGO-Datacloud
was conceived to tackle some of the Big Data challenges that scientific communities are facing. In the context of INDIGO-Datacloud we defined a case study in which one of the goals was the improvement of processing performance on seismological data. Starting with a practical case study, we identified, as possible software solution, Ophidia, a big data
analytics framework. The first step to exploit the framework functionalities required the import
of the seismological data in Ophidia. For this purpose, we designed and implemented a software
module that enables the import of seismological data in SAC format. As a second step, we tested
the capabilities of Ophidia through a performance test to evaluate the framework potential.
References
INDIGODataCloud,https://www.indigodatacloud.eu/
EMSOERIC,www.emso.eu
MOIST, http://www.moist.it
IRIS WEBSITE, http://ds.iris.edu/ds/nodes/dmc/software/downloads/sac/
SAC DATA FORMAT, https://ds.iris.edu/files/sacmanual/manual/file_format.html
Fiore S., Palazzo C., D'Anca A., Elia D., Londero E., Knapic C., Monna S., Marcucci N.M., Aguilar F., Pł.ciennik M., De Lucas J.E., (2017). Big Data Analytics on LargeScale Scientific Datasets in the INDIGO-DataCloud Project. In: Proceedings of the Computing Frontiers Conference 2017 May 15 (pp. 343348), ACM, doi:10.1145/3075564.3078884
OPHIDIA, http://ophidia.cmcc.it/
Fiore S., D’Anca A., Palazzo C., Foster I.T., Williams D.N., and Aloisio G., (2013). Ophidia: Toward big data analytics for escience. In: Proceedings of the International Conference on Computational Science, ICCS 2013, Barcelona, Spain, 57 June 2013, pp. 2376–2385, Elsevier.
Elia D., Fiore S., D’Anca A., Palazzo C., Foster I., Williams D.N., and Aloisio G., (2016). An in-memory based framework for scientific data analytics. In: Proceedings of the ACM International Conference on Computing Frontiers, pp. 424–429, ACM 2016.
UNIDATA, NetCDF, https://www.unidata.ucar.edu/software/netcdf/
Herrmann R.B., (2013). Computer programs in seismology: An evolving tool for instruction and research, Seism. Res. Lettr., 84, 10811088, doi:10.1785/0220110096
OPHIDIALAB, https://ophidialab.cmcc.it
Marcucci N.M., Monna S., D’Anca A. & Fiore S., (2017). Using Ophidia in EMSOINGV. Oral Presentation at INDIGO SUMMIT 2017 Conference (Catania, Italy).
EMSOERIC,www.emso.eu
MOIST, http://www.moist.it
IRIS WEBSITE, http://ds.iris.edu/ds/nodes/dmc/software/downloads/sac/
SAC DATA FORMAT, https://ds.iris.edu/files/sacmanual/manual/file_format.html
Fiore S., Palazzo C., D'Anca A., Elia D., Londero E., Knapic C., Monna S., Marcucci N.M., Aguilar F., Pł.ciennik M., De Lucas J.E., (2017). Big Data Analytics on LargeScale Scientific Datasets in the INDIGO-DataCloud Project. In: Proceedings of the Computing Frontiers Conference 2017 May 15 (pp. 343348), ACM, doi:10.1145/3075564.3078884
OPHIDIA, http://ophidia.cmcc.it/
Fiore S., D’Anca A., Palazzo C., Foster I.T., Williams D.N., and Aloisio G., (2013). Ophidia: Toward big data analytics for escience. In: Proceedings of the International Conference on Computational Science, ICCS 2013, Barcelona, Spain, 57 June 2013, pp. 2376–2385, Elsevier.
Elia D., Fiore S., D’Anca A., Palazzo C., Foster I., Williams D.N., and Aloisio G., (2016). An in-memory based framework for scientific data analytics. In: Proceedings of the ACM International Conference on Computing Frontiers, pp. 424–429, ACM 2016.
UNIDATA, NetCDF, https://www.unidata.ucar.edu/software/netcdf/
Herrmann R.B., (2013). Computer programs in seismology: An evolving tool for instruction and research, Seism. Res. Lettr., 84, 10811088, doi:10.1785/0220110096
OPHIDIALAB, https://ophidialab.cmcc.it
Marcucci N.M., Monna S., D’Anca A. & Fiore S., (2017). Using Ophidia in EMSOINGV. Oral Presentation at INDIGO SUMMIT 2017 Conference (Catania, Italy).
Type
article
File(s)![]()
Name
A procedure to import seismological data into the Ophidia big data analytics framework.pdf
Size
1.12 MB
Format
Adobe PDF
Checksum (MD5)
The MD5 message-digest algorithm can be used to verify the integrity of the file that you have uploaded. You can calculate its value locally via tools that are generally available in each operative system like md5sum
87ee8909ea9abc29c4f91a4d9dcf1127
