Development of a robust real-time synchronized data transmission technique from a Magnetic Observatory to an INTERMAGNET GIN

Abstract

This paper presents the step-by-step development and implementation of real-time data transmission from a distant Observatory. Using Python programming language, we have developed an algorithm for automated data transmission of high resolution real-time magnetic data from Choutuppal (CPL) and Hyderabad (HYB), India to INTERMAGNET Edinburgh GIN, with minimal internet services. We have designed a system to transfer the data in a secured and encrypted pattern with SSH keys and save the same dataset in the local server at CSIR-NGRI. Both the Observatories data are transmitted to GIN in real-time with a time frame of less than 300 s. After successfully transmitting real-time 1 min geomagnetic data from CPL and HYB Observatories to Edinburgh GIN, CPL's 1 s real-time data is also initiated and is one of the first Indian observatories to transmit real-time 1 s data to GIN. The details of algorithm development, function libraries and the challenges faced for 1 s and 1 min data transmission at both the Observatories are discussed.