StoRM is the storage element solution that powers the CNAF Tier-1 data center as well as more than 30 other sites. In this contribution, we highlight the main maintenance and evolution activities on StoRM during 2018.
StoRM is the storage element solution that powers the CNAF Tier1 data center as well as more than 30 other sites. In this contribution, we highlight the main maintenance and evolution activities on StoRM during 2018.
\end{abstract}
\section*{Introduction}
\label{sec:introduction}
StoRM~\cite{storm} is a lightweight storage resource manager (SRM) solution developed at INFN-CNAF which powers the CNAF Tier-1 data center as well as more than 30 other sites.
StoRM~\cite{storm} is a lightweight storage resource manager (SRM) solution developed at INFN-CNAF which powers the CNAF Tier1 data center as well as more than 30 other sites.
StoRM implements the SRM version 2.2~\cite{srm-2.2} data management specification and is typically deployed on top of a cluster file system like IBM GPFS~\cite{gpfs}.
...
...
@@ -56,7 +56,7 @@ During 2018, two StoRM releases where produced:
\item StoRM 1.11.14~\cite{storm-1.11.14}, released on July, 25th, providing updates for the frontend and backend services, StoRM native and xmlrpc libraries, the GridFTP DSI module and the YAIM module.
\end{itemize}
The following paragraphs describe the main StoRM maintenance and evolution activities that resulted in the above releases and in pre-release packages made available to the CNAF Tier-1 and other interested sites during 2018.
The following paragraphs describe the main StoRM maintenance and evolution activities that resulted in the above releases and in pre-release packages made available to the CNAF Tier1 and other interested sites during 2018.
\begin{figure}
\centering
...
...
@@ -66,7 +66,7 @@ The following paragraphs describe the main StoRM maintenance and evolution activ
\section*{StoRM frontend stability improvements}
After observing repeated failures that resulted in the death of the StoRM frontend process in production at Tier-1, an investigation was started
After observing repeated failures that resulted in the death of the StoRM frontend process in production at Tier1, an investigation was started
to understand the cause of the failures and provide a fix to improve
the service stability.
The failures occurred mainly when an high number of requests was observed on the frontend. Enabling core dumping did not provide much information, besides the fact that the segfault occurred mostly in the XMLRPC serializiation/deserialization logic, and was likely caused by stack corruption. What precisely caused the stack corruption however was not
...
...
@@ -112,7 +112,7 @@ In order to comply with the requirements \texttt{R0}, \texttt{R1} and \texttt{R2
\item a new command, \texttt{get-report-json}, has been added to the info provider to generate a JSON site report file, with a configurable target location.
\end{itemize}
To fulfill requirement \texttt{R2}, the Tier-1 StoRM ATLAS production instance has been configured to expose,
To fulfill requirement \texttt{R2}, the Tier1 StoRM ATLAS production instance has been configured to expose,
via the StoRM WebDAV service, the JSON usage report in a storage area accessible by any client presenting a trusted X.509 certificate.
\section*{Backend improved starting logic}
...
...
@@ -160,7 +160,7 @@ In order to comply with the requirement, the following improvements were introdu
\end{itemize}
A pre-release package of the updated StoRM WebDAV package was
deployed at CNAF Tier-1 for the ATLAS WebDAV production instance and added successfully to the DOMA TPC testbed where it showed to work reliably.
deployed at CNAF Tier1 for the ATLAS WebDAV production instance and added successfully to the DOMA TPC testbed where it showed to work reliably.
The initial deployment also highlighted minor issues which were solved, and lead to the final release of the StoRM WebDAV 1.1.0 release in Februrary 2019.