The Scientific Data and Computing Center (SDCC) at the U.S. Department of Energy's Brookhaven National Laboratory has achieved a significant milestone by storing over 300 petabytes of data. This makes it the largest tape archive in the U.S. for nuclear and particle physics experiments, according to Brookhaven Lab physicist Alexei Klimentov.
Brookhaven Lab engineer Tim Chou explained that their storage capacity could hold six or seven million movies, far exceeding the total number of films ever made since 1888. The data stored at SDCC comes from experiments conducted at the Relativistic Heavy Ion Collider (RHIC) and the ATLAS experiment at CERN's Large Hadron Collider (LHC). These facilities are crucial for exploring fundamental questions about matter and forces.
Chou emphasized that all stored data is accessible online, allowing global collaborators to retrieve information as needed. The SDCC uses a high-tech tape storage library where robots quickly mount requested data onto disks for easy access by scientists worldwide.
SDCC engineer Yingzi Wu highlighted the importance of monitoring systems and redundancy in managing data transfers effectively. She mentioned that artificial intelligence (AI) and machine learning (ML) algorithms help detect anomalies, easing operational burdens on staff.
Ognian Novakov noted that using a two-tiered tape-to-disk system is cost-effective, with tape being significantly cheaper than disk storage. Additionally, tape requires less energy than disks, which must spin continuously when in use.
The SDCC plans to expand its capacity further to accommodate future experiments like RHIC's transformation into an Electron-Ion Collider (EIC) and upgrades to increase LHC's collision rates. Smaller projects such as Belle II in Japan also contribute to SDCC's workload.
Klimentov pointed out that AI-enabled analysis now allows near-real-time processing of experimental data, improving anomaly detection during operations. This advancement could lead to quicker corrective actions and potential new discoveries.
Handling EIC data will require collaboration between Brookhaven Lab and DOE’s Thomas Jefferson National Accelerator Facility. Junior-generation physicists are gaining experience with current technologies in preparation for these future challenges.
SDCC operations receive funding from the DOE Office of Science.