This article originally appeared in Information Age.
Data volumes are exploding. More data has been created in the past two years than in the entire previous history of the human race.
By the year 2020, about 1.7 megabytes of new information will be created every second for every human being on the planet.
By then, our accumulated digital universe of data will grow from 4.4 zettabytes today to around 44 zettabytes, or 44 trillion gigabytes – a ten-fold increase in just four years.
Big data is also helping to make the world a better place, and there’s no better example than the uses being found for it in healthcare.
With the world’s population increasing and everyone living longer, models of treatment delivery are rapidly changing, and many of the decisions behind those changes are being driven by data.
The drive now is to understand as much about a patient as possible, as early in their life as possible – hopefully picking up warning signs of serious illness at an early enough stage that treatment is far more simple (and less expensive) than if it had not been spotted until later.
While big data is positively driving advances in healthcare, the storage and management of it are causing significant issues for IT managers – both because of the need to store, archive and preserve large volumes of data for future research, as well as dealing with the security and compliance challenges associated with it.
So what’s the best way for healthcare organisations to go about storing and archiving these huge volumes of big data safely, secularly and cost-effectively?
Pathology is an example of an area in the NHS that is undergoing disruptive change and where new digital processes are introducing challenges to old ways of working. However, in doing so these new processes are also introducing fantastic new opportunities bought about by big data.
Managers of digital pathology labs are benefiting from digital workflows that are fostering innovation in how pathology practices are transforming patient care.
Static data ≠ backup window
Even a modest pathology lab with one small slide scanner will generate over 15 terabytes of data per year. And the responsibility for storing, managing and securing this volume of data over decade-long timescales – all the while taking into account the compliance, security, cost and data integrity requirements associated with its storage – is falling on IT departments.
IT managers have their own challenges arising from this, not least of which is procuring and managing new infrastructure, but also having significant new data appearing in the backup window.
Looking at numbers like this, and when you start to consider what is required to successfully store this data, it quickly becomes clear that pathology laboratories, as well as hospitals and other medical research institutions, have a significant task on their hands.
Specialists can help
The good news is that there are in fact specialist managed data storage services that are positively disrupting how big data is being secured and stored. And they’re reducing costs, meeting NHS and healthcare compliance requirements, and delivering the long-term efficiency benefits that enable digital workflows to flourish.
Healthcare organisations should consider bringing in one of these specialist providers of long-term data archiving to implement a managed service that has been specifically designed from the ground up to provide ultra secure storage for large volumes of data for extended periods of time.
Healthcare organisations across the board are all looking for ways to manage their data. Hospitals, genetics laboratories, fertility clinics and digital pathologists alike need to consider the most effective way to ensure that all this big data is properly managed.
Get more insights
To learn more about how straightforward it is to reap the benefits of efficient digital pathology data management, you can download our new White Paper: Managing Big Data – Reaping the Rewards. In the paper we detail the issues and challenges that are being faced by digital pathology labs when implementing technologies like whole slide imaging and we highlight what a digital pathology data storage strategy needs to include.