Media Asset Storage: it's in our DNA
31/03/2020
SCREEN AFRICA EXCLUSIVE:
When it comes to the storage of media assets (or any data, for that matter), whether it's online or up on the cloud, there's no doubt that the immediate future of data storage remains magnetic tape. Recent technological advancements have given new life to hard drives, but when it comes to long-term archiving of assets, the tape or hard drive of the future could be something very old, something that everyone has inside them: DNA.
The first commercial digital-tape storage system, IBM's Model 726, could store about 1.1 megabytes on one reel of tape. Today, a modern LTO tape cartridge can hold 30 terabytes. Meanwhile, a single robotic tape library can contain up to 556 petabytes of data. While tape doesn't offer the fast read/write speeds of hard drives, the medium's advantages are many.
For starters, tape is reliable, with error rates four to five orders of magnitude lower than those of hard drives. They are energy efficient: once all the data has been written, the tape cartridge simply sits in a slot in a tape library without consuming any power until it's needed again. And tape is very secure, with built-in, on-the-fly encryption and if a cartridge isn't mounted in a drive, the data cannot be accessed or modified. The main reason why tape is so popular is simple economics. Tape storage costs one-sixth the amount you'd have to pay to keep the same amount of data on disks, which is why you find tape systems almost any place where massive amounts of data are being stored.
But, as mentioned, tape is slow, and so the development of hard drive technology continues. The longevity of hard disks, and the rapid rise of solid-state drives (SSDs), can be attributed to a continual improvement process to minimise the drawbacks of tape technology. The hard disk game changed dramatically in 2005 with perpendicular magnetic recording (PMR), where, broadly speaking, magnetised bits stand perpendicular to the head of the hard disk platter instead of lying down, making room for more bits. However, after years of data density improvements using PMR (densities doubled between 2009 and 2015), researchers are once again hitting the physical limits: each magnetic bit' is becoming too small to reliably hold its data, increasing the potential for corruption.
Shingled magnetic recording (SMR), introduced by Seagate in 2014, is one way to fit more data on a disk's platter. In an SMR disk, when the write head writes a data track, the new track will overlap part of the previously written track, reducing its width and meaning more tracks can fit on a platter. The thinner track can still be read, as read heads can be physically thinner than write heads. Western Digital launched a 15TB SMR hard drive in 2018 targeting data centres, with plans to increase the capacity per rack by up to 60TB soon.
The next big thing is two-dimensional magnetic recording (TDMR). This is another Seagate technology, and aims to solve the problem of reading data from tightly packed hard disk tracks, where the read head picks up interference from tracks around the one being read. TDMR disks use multiple read heads to pick up data from several tracks at a time, then work out which data is needed, turning the noise into useful data that can be analysed and then discarded when not required. 14 and 16TB TDMR drives came onto the market in 2019.
The multiple read heads of TDMR disks can improve read speeds, but to improve write speeds while increasing data density you need to move away from SMR to the latest hard disk technology: heat-assisted magnetic recording (HAMR). This aims to overcome the compromise of SMR by changing the material of the hard disk platter, to one where each bit will maintain its magnetic data integrity at a smaller size. As HAMR's name implies, the solution is to use a laser to heat up part of the hard disk platter before the data is written. This lowers the material's coercivity enough for the data to be written, before the heated section cools and the coercivity rises again to make the data secure. HAMR has the potential to increase hard disk density tenfold.
Therefore, both hard drive and magnetic tape technologies work for the storage and retrieval of data assets but the trouble is that technology is battling to keep up with the continual flood of data currently being generated, and forecast to be generated in the future. What's the solution? The hard drive of the future could actually be something very old, something that is inside every person reading this: DNA.
Deoxyribonucleic acid, or DNA, is the molecule that dictates how an organism develops. DNA can also hold a staggering amount of information: 215 petabytes (1 petabyte is about 100 million gigabytes) of data on a single gram. Just as impressive is its longevity. Traditional mediums like magnetic tape and flash memory tend to degrade, whether through repeated use or simply time. DNA degrades, too, but at a significantly slower rate: depending on the storage conditions, it can last thousands, or even tens of thousands, of years.
The idea of storing data on DNA was proposed back in the 1960s by Soviet scientist Mikhail Neiman. In the decades since, researchers have made great strides in making it achievable - though at a price. Currently, the most cost-effective DNA storage technique costs about US$3,500 per MB to write the data and US$1,000 per MB to read it, so don't retire your LTO or hard drive array just yet.
DNA's storage capabilities, however, are intriguing and have huge potential for computing in the future. For years, technology roughly followed the path laid out by Moore's Law, which stated that every two years or so, we could double the number of transistors that fit on a microchip. However, computer chips have become so small these day
LINK: | https://www.screenafrica.com/2020/03/31/technology/storage-asset-manag... |
See more stories from screenafrica |
More from Screen Africa
30/04/2020
All the SAFTAs14 winners
-- -- The 14th South African Film & Television Awards (SAFTAs) ceremony was held on social media platform, across Twitter, Facebook and YouTube in an effo...
01/04/2020
The NFVF to offer immediate relief to film practitioners amid COVID-19...
-- -- South Africa's local film and television industry has been severely impacted by Covid-19 and a number of productions have been haltered not to m...
31/03/2020
Media Asset Storage: it's in our DNA
-- -- SCREEN AFRICA EXCLUSIVE: When it comes to the storage of media assets (or any data, for that matter), whether it's online or up on the cloud, ...
31/03/2020
How to maximise business objectives using hybrid cloud architecture
-- -- SCREEN AFRICA EXCLUSIVE: Written by Jerome Wauthoz, vice president of products, Tedial The cloud has had a major impact on broadcast workflows, wi...
31/03/2020
Netflix increases investment in Africa
Dorothy Ghettuba -- -- SCREEN AFRICA EXCLUSIVE: Netflix premiered its first script-to-screen African original production, Queen Sono, on 28 February. C...
31/03/2020
How brands can self-medicate during this pandemic
-- -- SCREEN AFRICA EXCLUSIVE: In a market where there is only uncertainty, and where many industries have already collapsed, as businesses face ruin and...
30/03/2020
Multichoice Group supports local entertainment industry during Covid-19
-- -- Everyday various sectors across our continent are adjusting and finding ways to deal with challenges brought about by the current coronavirus pandem...
30/03/2020
DISCOP postpones 2020 African events
-- -- On 28 March, Patrick Zuchowicki, president of DISCOP markets, announced the postponement of DISCOP's 2020 African markets. With much regret, I ...
27/03/2020
Rage, the first Showmax Original horror
-- -- -- In Rage, Showmax's first Original horror movie, a group of school-leavers descend on a tiny coastal town for a celebration of their freedo...
27/03/2020
The KwaZulu-Natal Film Commission turns five
Carol Coetzee,KZNFC CEO -- -- SCREEN AFRICA EXCLUSIVE: This year marks five years since the inception of the KwaZulu-Natal Film Commission (KZNFC). We s...
27/03/2020
Inside the making of Trap! Dis My Huis
-- -- SCREEN AFRICA EXCLUSIVE: Currently screening on Afrikaans lifestyle channel VIA (DStv 147), new South African TV show Trap! Dis My Huis - co-prese...
26/03/2020
Botswana film Okavango wins big at the New York Cinematography Awards...
-- -- Botswana-based wildlife filmmakers, Dereck and Beverly Joubert's film Okavango won five awards at the 2020 New York Cinematography Awards (NYCA)...
26/03/2020
It's about the numbers
-- -- SCREEN AFRICA EXCLUSIVE: Sometimes it feels like there might be something in the water. By that, I refer to the experience when you find yourself o...
25/03/2020
Graphic Content
-- -- SCREEN AFRICA EXCLUSIVE: In a changing broadcast environment, where streaming of content directly to the viewer is becoming the new norm, the need ...
25/03/2020
XenData announces multi-site sync service for cloud object storage
-- -- XenData, a global provider of data storage solutions, announces its new Multi-Site Sync service for cloud object storage which creates a global file...
24/03/2020
Shogun 7 adds better monitoring and affordable 4K ProRes recording to...
-- -- -- On-set at DP Alan Stockdale's latest colorful music video: Atomos' Shogun 7 monitor-recorder was used to enhance the amazing capabili...
24/03/2020
IABM launches virtual repository to collate Business Continuity Resources for Broadcast...
-- -- IABM, the international association for broadcast and media technolo...
23/03/2020
IPO statement on COVID-19
-- -- The Independent Producers Organisation (IPO) executive committee recently issued a statement with regards to COVID-19 and current developments withi...
23/03/2020
The making of an African Sundance classic
-- -- SCREEN AFRICA EXCLUSIVE: Lemohang Jeremiah Mosese is a self-taught filmmaker and visual artist from Lesotho, now based in Berlin. His film Mother, ...
20/03/2020
Ninth Cape Town International Animation Festival postponed to April 2021
Cape Town International Film Market & Festival 2017 -- -- The ninth Cape Town International Animation Festival (CTIAF) has been postponed to 24 to 27 Apr...
19/03/2020
Durban FilmMart partners with Talents Durban and announces call for applications...
-- -- The Durban FilmMart has announced a new partnership with Talents Dur...
18/03/2020
MultiChoice and Microsoft look to the future of entertainment in Africa
-- -- The world of entertainment is changing rapidly. Increased access to fibre to the home, as well as a growing number of content creators and video-on-...
18/03/2020
How cloud technology is evolving the broadcast industry
-- -- SCREEN AFRICA EXCLUSIVE: Written by Andreas Jacobi, CEO and co-founder of Make.TV a division of LTN Global The South African TV market continu...
18/03/2020
The 2020 Media Production & Technology Show postponed
-- -- The organisers of the Media Production & Technology Show have announced the postponement of the 2020 event as a result of the spread of COVID-19. ...
17/03/2020
Canon reveals further EOS R5 video capabilities
-- -- Exactly a month since its development announcement of the EOS R5 - a full frame mirrorless camera built on the revolutionary EOS R System - Canon In...
17/03/2020
MultiChoice and Microsoft to look to the future of entertainment in...
-- -- The world of entertainment is changing rapidly. Increased access to fibre to the home, as well as a growing number of content creators and video-on-...
16/03/2020
Gauteng Department of Economic Development launches IP conference for creative industries
-- -- SCREEN AFRICA EXCLUSIVE: In an effort to increase awareness and un...
16/03/2020
Discovery Inc appoints Clare O' Neil as commercial director for Africa
-- -- Discovery Inc has appointed Clare O' Neil as their commercial director for Discovery in Africa. O' Neil's focus will be on driving comme...
16/03/2020
Moroccan film Monsters dominates at the RapidLion 2020 awards ceremony
-- -- RapidLion - The South African International Film Festival awarded 16 winners at its 2020 awards ceremony which took place on Saturday, 14 March in J...
16/03/2020
SAFTAs14 ceremony cancelled due to COVID19 outbreak
-- -- The National Film & Video Foundation have announced that the 2020 SAFTAs ceremony will not go ahead as planned. In light of the announcement made ...
12/03/2020
NAB Show 2020 cancelled due to the coronavirus outbreak
-- -- The 2020 edition of the annual NAB Show, which was scheduled to run this April in Las Vegas, has been cancelled due to concerns over the spread of c...
11/03/2020
Grass Valley spotlights innovation at NAB Show 2020
-- -- At what will be the first major public appearance following the announcement of Black Dragon Capital's intent to acquire Grass Valley, at NAB Sh...
11/03/2020
Avid cancels Avid Connect 2020 and NAB Show participation in response...
-- -- In response to the coronavirus outbreak, media technology leader Avid has announced its decision to cancel participation in all trade conferences an...
10/03/2020
World Literacy Foundation and Vizrt Group launch international partnership to tackle...
-- -- The World Literacy Foundation and the Vizrt Group have announced an ...
10/03/2020
EditShare NAB 2020 highlights
-- -- At NAB Show 2020, EditShare, through workflow demonstrations and theatre presentations, will showcase how their scale-out shared storage and collabo...
09/03/2020
Welcome changes to South Africa's IP exchange controls announced
Leanne Mostert, Webber Wentzel -- -- Written by Leanne Mostert, Bernadette Versfeld, Tim Ball, Carla Collett, Cameron MacKenzie from Webber Wentzel The ...
09/03/2020
WarnerMedia's Ariane Suveg on Cartoon Network Africa's Creative Lab and African...
-- -- SCREEN AFRICA EXCLUSIVE: A year after announcing Cartoon Network A...
09/03/2020
Challenges and opportunities for production studios
Charlene Govender, Sasani Studios -- -- SCREEN AFRICA EXCLUSIVE: Screen Africa chats to Charlene Govender of Sasani Studios about how increased investm...
06/03/2020
NFVF celebrates the launch of the Eastern Cape Film Hub
-- -- On 5 March, in the attendance of the Minister of Sports, Arts and Culture, Nathi Mthethwa and Eastern Cape Premier Lubabalo Oscar Mabuyane, the East...
04/03/2020
2020 A milestone year for many across the streaming landscape
-- -- The streaming media industry is now entering a new era, as major launches and acquisitions carve out a global landscape for 2020 and beyond. US Dire...
04/03/2020
TVU Networks to showcase innovative 5G and remote production deployments at...
TVU MediaMind -- -- TVU Networks, a global technology and innovation leader in live IP solutions and Technology and Engineering Emmy Award winner, will ...
04/03/2020
Using lighting to stream data
Image credit: University of Edinburgh -- -- SCREEN AFRICA EXCLUSIVE: When is technology development ever going to slow down? Just when you thought that...
04/03/2020
Behind the news - an inside look into eNCA's massive in-studio...
-- -- In a world that is fast-paced and ever-evolving, remaining the same is not an option. This seems to be the mantra that South Africa's number one...
03/03/2020
Calrec showcases AoIP and virtual mixing capabilities at NAB 2020
-- -- For more than 50 years the world's most successful broadcasters have relied on Calrec. They still do. As our industry adapts to new viewing habi...
02/03/2020
Netflix announces first Nigerian original
-- -- On 27 February, Netflix announced that it will increase its investment in Nigeria's creative community with the production of its first African ...
02/03/2020
The gamechangers of the next decade
Generation Z (Source: Pexels.com) -- -- SCREEN AFRICA EXCLUSIVE: Standing at the beginning of a new year in a new decade is exciting. This new decade, i...
02/03/2020
Inside the making of virtual reality film, Azibuye - The Occupation
-- -- SCREEN AFRICA EXCLUSIVE: It's not a secret that the issue of land redistribution remains a contentious and highly emotional subject in post-Ap...
28/02/2020
Somhale wedding takes viewing crown
-- -- -- More than half of the catalogue of TV shows and movies on Showmax, whether measured in hours or number of episodes, is now local content. This...