INFN C@C review

contributions/ds_cloud_c/ds_cloud_c.tex

@@ -36,13 +36,12 @@ international projects hosted at CNAF:
   \item Internal activities
     \begin{itemize}
     \item Provisioning VM for CNAF departments and staff members
-    \item Provisioning of VM for CNAF staff members
     \item Tutorial and courses
     \end{itemize}
   \item National and international projects
     \begin{itemize}
-      \item Providing VMs for experiments hosted at CNAF, like CMS, ATLAS, EEE
-      \item testbeds for testing the services developed by projects like the OpenCityPlatform \& INDIGO-DataCloud
+      \item Providing VMs for experiments hosted at CNAF, like CMS, ATLAS, EEE and FAZIA
+      \item testbeds for testing the services developed by projects like the INDIGO-DataCloud, eXtreme-DataCLoud and DEEP-HybridDataCloud
     \end{itemize}
 \end{itemize}
 
@@ -70,49 +69,83 @@ core machinery and related services.
 Due to the geographical proximity and the presence of Point of Presence (PoP) GARR, the 
 Cloud@CNAF core machinery was moved to the INFN-Ferrara location.
 
-Unfortunately, INFN-Ferrara was not able to host all the Cloud@CNAF resources due to a limited power availability and weight.
+Unfortunately, we were not able to move all the Cloud@CNAF resources due to a limited power and weight availability in the new location.
 For the above mentioned reason, the re-design of the new infrastructure has been considered.
 As a first step, the services and the related machinery to move to the new - temporary - location have been selected in order to
  fit the maximum power consumption and weight estimated for each of the two rooms devoted to host Cloud@CNAF services (see Table \ref{table:1} for details).
 
+\begin{table} [ht]
+\centering
+\begin{tabular}{ l|c|c|c||c||c| } 
+\cline{2-6}
+ & \multicolumn{3}{c||}{Room1}  &  Room2 & Tot \\
+\cline{2-5}
+ & Rack1 & Rack2 & Tot &  Rack3 &  \\
+\hline
+Power consumption (kW) & 8,88 &  4,91 & 13,79 (15) & 5,8 (7)& 19,59\\ 
+Weight (Kg) & 201 & 151 & 352 (400Kg/mq) & 92 (400Kg/mq) & 444 \\ 
+Occupancy (U) & 9 & 12 & 21 & 10 & 31 \\ 
+\hline
+\end{tabular}
+\caption{Power consumption weight and occupancy for each Rack. In brackets, the maximum value admitted for the Room.}
+\label{table:1}
+\end{table}
 
 \section{Re-design the new infrastructure}
-Due to the limitations described in Table\ref{table:1} only three racks have been used to host Cloud@CNAF core service
-Among this three racks, the first hosts the storage resources, the second hosts the Openstack controller and network
- services, together with the GPFS cluster and other services. The third hosts Ovirt and Openstack compute nodes, together with
- some other ancillary services.
+Due to the limitations described in Table\ref{table:1} only three racks have been used to host Cloud@CNAF core service.
+Among this three racks, the first hosts the storage resources, the second hosts the Openstack controller, the network
+ services and the GPFS cluster. The third hosts Ovirt and Openstack compute nodes, together with
+ some other ancillary services  (see Table \ref{table:2} for details).
 Rack1 and Rack2 have been connected by 2x40Gbps through our Brocade VDX switches and Rack1 and Rack3 have been connected 
 by 2x10Gbps through PowerConnect switches.
 
+\begin{table} [ht]
+\centering
+\begin{tabular}{ c|l|l|l| } 
+\cline{2-4}
+& \multicolumn{1}{|c|}{Rack1} & \multicolumn{1}{|c|}{Rack2} & \multicolumn{1}{|c|}{Rack3}\\
+\hline
+& VDX & VDX &  PowerConnect x2 \\ 
+Resources & EqualLogic & Cloud controllers &  Ovirt nodes\\ 
+and & Powervault & Cloud networks & Compute nodes\\
+Services & & Gridstore & DBs nodes\\
+& &  Other services & Cloud UI\\
+\hline
+\end{tabular}
+\caption{List of resources and services hosted per Rack}
+\label{table:2}
+\end{table}
+
 Moreover, Rack1 is connected to PoP GARR with 1x1Gbps fiber connection to guarantee external connectivity.
 A complete overview of the new infrastructure and related resource location is shown in Figure \ref{new_c_at_c}.
 As depicted from the Figure \ref{new_c_at_c}  and taking into account the limitations described in Table \ref{table:1}) the power consumption
 has been limited  up to 13,79kW in respect to Room1 (limit 15kW) and up to 5.8kW (limit 7kW) in respect to Room2.
 
-The whole migration process (from the design to the reconfiguration of the new infrastructure) took almost a business week 
+The whole migration process (from the design to the reconfiguration of the new infrastructure) took just a business week 
 and after that the Cloud@CNAF infrastructure and related services where up and running, able to serve again different projects and communities.
 
-Thanks to the experience and the documentation provided, in June 2018 - after the Tier1 returned in its production status, 
+Thanks to the experience and documentation gathered, in June 2018 - after the Tier1 returned in its production status, 
 Cloud@CNAF has been migrated back in less than three business days.
 
 \section{Cloud@CNAF evolution}
 
 Starting from the activity carried out in 2016 related to the improvements done at the infrastructure level \cite{catc}, in 
 2018 (after the return of the core infrastructure services due to the flooding) 
-the increase of the computing  resources, in terms of quality and quantity, continued in order to enhance the both the
- services and the performance  offered to  users.
+the increase of the computing  resources, in terms of quality and quantity, continued in order to enhance both the
+ services and the performance offered to users.
 
 Thanks to such activity, during the last year the Cloud@CNAF saw a growth on the number of users and use cases
- implemented in the infrastructure, in particular the number of projects increased up to 87 which means a total consumption 
-of 1035 virtual CPUS, 1.766TB of RAM, with a total of 267 virtual machines (see Figure \ref{catc_monitor} for more details).
+ implemented in the infrastructure, in particular the number of projects increased up to 87 using approximately 
+ 1035 virtual CPUS, 1.766TB of RAM, with a total of 267 virtual machines (see Figure \ref{catc_monitor} for more details).
 
-Among others, some of the project that used the cloud infrastructure are: 
+Among others, some of the projects that used the cloud infrastructure are: 
 \begin{itemize}
-\item HARMONY - proof-of-concept under the TTLab coordination, is a project aimed at finding resourceful medicines offensive against neoplasms in hematology
+\item HARMONY - Proof-of-concept under the TTLab coordination, is a project aimed at finding resourceful medicines offensive against neoplasms in hematology,
 \item EEE - Extreme Energy Events - Science inside Schools (EEE), is a special research activity about the origin of cosmic rays carried out with the essential contribution of students and teachers of high schools,
+\item CHNET-DHLab - Cultural heritage network of INFN for the development of virtual laboratories services, 
 \item USER Support - for the development of experiments dashboard and the hosting of the production instance of the dashboard, displayed on the monitor present on the CNAF hallway,
-\item DODAS  -  for  Elastic  Extension  of  Computing  Centre  batch resources  on  external  clouds,
-\item Services devoted to EU projects like DEEP-HDC \cite{deep}, XDC \cite{xdc} and many more.
+\item EOSC-hub DODAS - Temaic service for  Elastic  Extension  of  Computing  Centre  batch resources  on  external  clouds,
+\item Services devoted to EU projects like DEEP-HDC \cite{deep}, XDC \cite{xdc} and EOSC-pilot \cite{pilot}.
 \end{itemize}
 
 
@@ -125,45 +158,14 @@ In order to do this, a complete re-design of the entire infrastructure was neede
  weight imposed by the new location.
 The joint effort and expertise of all the CNAF people and the INFN-Ferrara colleagues made possible to re-design, migrate and make operational 
 the Cloud@CNAF infrastructure and related hosted services in less than a business week.
-Thanks to the experience and the documentation provided, in June 2018 - after the Tier1 returned in its production status, Cloud@CNAF 
+Thanks to the experience and the documentation gathered, in June 2018 - after the Tier1 returned in its production status, Cloud@CNAF 
 has been migrated back in less than three business days.
 Even with the above described problems, the Cloud@CNAF infrastructure has been maintained and evolved, giving the possibility 
-to the users to continue their activities and carry out their results.
-In the next year new and challenging activities are planned, in particular the migration to the OpenStack Rocky version and the deployment of a new architecture. 
-
-
-\begin{table} [ht]
-\centering
-\begin{tabular}{ |c|c|c|c|c|c|c| } 
-\hline
- & Rack1 & Rack2 & Rack3 & Room1 (Max) & Room2 (Max)& Tot \\
-\hline
-Power consumption (kW) & 8,88 &  4,91 & 5,8 & 13,79 (15) & 5,8 (7) & 19,59\\ 
-Weight (Kg) & 201 &  151  & 92 & 352 (400Kg/mq) & 92 (400Kg/mq) & 444 \\ 
-Occupancy (U) & 9 &  12 & 10 & 21 & 10 & 31 \\ 
-\hline
-\end{tabular}
-\caption{Power consumption weight and occupancy for each Rack}
-\label{table:1}
-\end{table}
+to the users to carry on their activities and obtain their desidered results.
+For the next year new and challenging activities are planned, in particular the migration to the OpenStack Rocky version and the deployment of a new architecture distributed between 
+differnet functional units, Data Center and SDDS. 
 
 
-\begin{table} [ht]
-\centering
-\begin{tabular}{ |c|c|c|c| } 
-\hline
-Rack1 & Rack2 & Rack3 \\
-\hline
-VDX & VDX &  PowerConnect x2 \\ 
-EqualLogic & Cloud controllers &  Ovirt nodes\\ 
-Powervault & Cloud networks & Compute nodes \\
-& Gridstore & DBs nodes\\
-&  Other services & Cloud UI \\
-\hline
-\end{tabular}
-\caption{List of resources and services hosted per Rack}
-\label{table:2}
-\end{table}
 
 \begin{figure}[h]
 \centering
@@ -174,7 +176,7 @@ Powervault & Cloud networks & Compute nodes \\
 
 \begin{figure}[h]
 \centering
-\includegraphics[width=15cm,clip]{catc_monitoring.png}
+\includegraphics[width=12cm,clip]{catc_monitoring.png}
 \caption{Cloud@CNAF monitoring and status}
 \label{catc_monitor}
 \end{figure}
@@ -193,7 +195,8 @@ The flood, L. dell’Agnello, CNAF Annual Report 2017, https://www.cnaf.infn.it/
 Web site: https://deep-hybrid-datacloud.eu/
 \bibitem{xdc}
 Web site: www.extreme-datacloud.eu
-
+\bibitem{pilot}
+Web site: https://eoscpilot.eu
 
 
 \end{thebibliography}