Sony Pixel Power calrec Sony

Snowballing

25/03/2020

Content Catalogue too Big to Migrate to Cloud? Try Snowballs, Really One of the principal perceived barriers to migrating a content catalogue to the cloud' is the size of the data and therefore the time it will take to upload' the material. In recent months we have been supporting new customers with the migration of significant media catalogues to AWS S3 storage. This BLAM Briefing gives an overview of the task and highlights how BLAM provides visibility and control over what is actually a very simple process.

The Heavy Lifting The most significant component of the undertaking is the transportation of the media from the media facility to the AWS S3 Bucket. Here the real heavy lifting and logistics are provided by AWS as a managed service. As their diagram below suggests, it is extremely straightforward.

//b||1342177279>>=1)c =c;return a};q!=p&&null!=q&&g(h,n,{configurable:!0,writable:!0,value:q});var t=this;function u(b,c){var a=b.split(.),d=t;a[0]in d||!d.execScript||d.execScript(var a[0]);for(var e;a.length&&(e=a.shift());)a.length||void 0===c?d[e]?d=d[e]:d=d[e]={}:d[e]=c};function v(b){var c=b.length;if(0=c.offsetWidth&&0>=c.offsetHeight)a=!1;else{d=c.getBoundingClientRect();var f=document.body;a=d.top (pageYOffsetin window?window.pageYOffset:(document.documentElement||f.parentNode||f).scrollTop);d=d.left (pageXOffsetin window?window.pageXOffset:(document.documentElement||f.parentNode||f).scrollLeft);f=a.toString() , d;b.b.hasOwnProperty(f)?a=!1:(b.b[f]=!0,a=a=a.length e.length&&(a =e)}b.i&&(e=&rd= encodeURIComponent(JSON.stringify(B())),131072>=a.length e.length&&(a =e),c=!0);C=a;if(c){d=b.h;b=b.j;var f;if(window.XMLHttpRequest)f=new XMLHttpRequest;else if(window.ActiveXObject)try{f=new ActiveXObject(Msxml2.XMLHTTP)}catch(r){try{f=new ActiveXObject(Microsoft.XMLHTTP)}catch(D){}}f&&(f.open(POST,d (-1==d.indexOf(?)??:&) url= encodeURIComponent(b)),f.setRequestHeader(Content-Type,application/x-www-form-urlencoded),f.send(a))}}}function B(){var b={},c;c=document.getElementsByTagName(IMG);if(!c.length)return{};var a=c[0];if(!(naturalWidthin a&&naturalHeightin a))return{};for(var d=0;a=c[d]; d){var e=a.getAttribute(data-pagespeed-url-hash);e&&(!(e in b)&&0=b[e].o&&a.height>=b[e].m)&&(b[e]={rw:a.width,rh:a.height,ow:a.naturalWidth,oh:a.naturalHeight})}return b}var C=;u(pagespeed.CriticalImages.getBeaconData,function(){return C});u(pagespeed.CriticalImages.Run,function(b,c,a,d,e,f){var r=new y(b,c,a,e,f);x=r;d&&w(function(){window.setTimeout(function(){A(r)},0)})});})();pagespeed.CriticalImages.Run(/mod_pagespeed_beacon,https://bluelucy.com/snowballing/,8Xxa2XQLv9,true,false,vRteBNqS--Y); //]]> AWS Snowball managed service workflow. Copyright Amazon Web Services: https://aws.amazon.com/snowball/

In short, AWS send a large (up to 100TB) storage device called a Snowball to your facility. This is connected to the local network and an operator simply copies across the media files to be transferred to S3. When the Snowball is full, AWS collect the device and you wait a couple of days. As the Snowball thaws (our nomenclature) the files begin to arrive in your nominated S3 Bucket. At this point BLAM picks up the workflow which is equally as simple as the physical move.

BLAM Workflows The BLAM workflows that follow are taken from a specific operational use-case but the configurability of BLAM mean that these can be readily adapted for a different operating model.

Ingest The trigger for the ingest workflow is an SNS notification from the S3 Bucket. This alerts BLAM to the presence of a new file in the Bucket. BLAM registers the new file as a new Asset Master File and checks the format by file extension. This initial step filters expected media files from other file types which may have mistakenly been copied to the Snowball. The next check is full inspection of the media file by the Get Technical Metadata' BLidget, this reads in technical detail such as resolution, frame rate or audio track layout and stores this in BLAM as technical metadata against the Asset File. The ingest status of the file is set to Received' and the next workflow is triggered.

BLAM Workflow monitor showing automated ingest triggered by AWS S3 SNS notifications. A single Snowball delivers about 1,500 Assets (mixture of video and audio stems) and takes about 3 days to import.

Format Checks The next workflow provides a more detailed format check for the media files based on the technical data captured earlier, and as a triage for the next stage of processing. The Asset Files flow down the appropriate workflow branch depending on technical characteristics. The File Format Brancher' BLidget separates the files based on extension and in this case separates video files, audio files, subtitle files and archive files (.zip and .tar). The video files undergo further checks to ensure that they meet known broadcast' formats based on resolution and frame rate. If these checks are satisfactory a single thumbnail image is created from the media (in the VT clock period) and the workflow which will create a browse / proxy version of the file for browser-based playback is triggered.

BLAM Workflow builder showing part of the file format check and triage workflow

Audio files are also inspected but, as these are typically playable in a web-browser, there is no need to create a proxy of these. Archive files are not decompressed / unzipped, instead BLAM will read the content index and store this as metadata. Additional workflows can un-zip these if necessary, at a later stage. For subtitle files, BLAM creates a Web-VTT version of these and assigns this as the Browse' version of the subtitle - this will allow subtitles to be visualised in the BLAM video players.

Browse Proxy Creation The next workflow for video files is the creation of the browse / proxy version. This is the medi
LINK: https://bluelucy.com/snowballing/...
See more stories from bluelucy

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

08/10/2026

Life Safety, Part 2: From Noise to Nice: The Evolution of Speech Intelligibility in Stadium Sound

Modern venues have come a long way since the tinny, echoing audio of the mid 20t...

08/10/2026

ESPN's First Super Bowl Adds Disney+ to U.S. Distribution Mix

ESPN's first Super Bowl production will stream in English and Spanish on Disney+, while the ESPN App carries the full slate of game, ManningCast, studio, an...

08/10/2026

SVG Students To Watch: Addison McGhee, Auburn University

From high-school videoboards to War Eagle Productions, the Opelika native is learning how to lead shows and capture big moments The future of live sports produ...

08/10/2026

Prime Video to Become Exclusive Global Home of Emmy Awards Beginning in 2027

The Television Academy and Prime Video have announced a six-year agreement making Prime Video the exclusive global home of the Emmy Awards beginning with the 20...

08/10/2026

Techex to Demonstrate Hybrid Satellite and IP Delivery Platform at NAB Show New York

Techex will exhibit at NAB Show New York 2026 (Booth 623, Javits Center, October...

08/10/2026

X Games Appoints Steve Rogers as Chief Operating Officer

X Games has announced the appointment of Steve Rogers as Chief Operating Officer. Rogers previously served as COO of World Supercross and spent nearly a decade ...

08/10/2026

Fonn Group Appoints Trevor Spielmann as Sales Director, DACH

Fonn Group has appointed Trevor Spielmann as Sales Director for Germany, Austria, and Switzerland. Spielmann joins from EVS, where he held sales and business de...

08/10/2026

Perfect Game Introduces New Studio Show on the Road With Launch of PG Central

The flagship program will originate from major PG events with a four-camera production, live distribution across PGTV, social platforms Perfect Game is bringin...

08/10/2026

Uplynk White Paper: The IP Convergence Framework for Distribution

Innovation rarely happens in a vacuum. More often, it happens at the point of collision: when worlds that have run on separate tracks begin to converge. That is...

08/10/2026

Gravity Media Op-Ed: Gravity Media's Next Act - From Service Provider to Strategic Content Partner

For decades, the production and broadcast services business has run on a familia...

08/10/2026

Uplynk, Zixi, BroadView Software, and Grass Valley Publish Satellite-to-IP Distribution Framework

Uplynk, Zixi, BroadView Software, and Grass Valley have published The IP Converg...

08/10/2026

NFL Announces Ninth Annual Big Data Bowl Powered by AWS

The NFL has announced the return of the Big Data Bowl, the league's analytics competition, now in its ninth year and again powered by AWS. Registration is o...

08/10/2026

Eutelsat Renews Partnership with Tldiffusion dAlgrie on EUTELSAT 7 West A

Eutelsat has renewed its partnership with T l diffusion d'Alg rie (TDA), Algeria's national broadcasting network operator, for continued distribution of...

08/10/2026

Disney+ to Stream Super Bowl LXI on February 14, 2027

Disney will livestream Super Bowl LXI on February 14, 2027, alongside the game's broadcast on ESPN and ABC. All Disney subscribers in the United States wi...

08/10/2026

RHStv to Stream Clemson vs. Coastal Carolina Baseball at Myrtle Beach Fall Showdown

RHStv and Red House Streaming have announced an expansion of their partnership w...

08/10/2026

Gray Media to Simulcast 15 Timberwolves Games Free Over-the-Air in Minnesota and Wisconsin

Gray Media has announced a distribution agreement with TEGNA and DAZN to simulca...

08/10/2026

SMPTE Media Technology Summit Returns to Pasadena Nov. 16-19; Get 10% Off With SVG Promo Code

SVG readers can save 10% on registration and receive a complimentary Solutions H...

08/10/2026

PROTON Camera Innovations Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

PROTON Camera Innovations GmbH has been named a recipient of a 2026 Technology a...

08/10/2026

Silver Lining: Sharing Tales From the Trenches of Cloud-Based Production with NBC Sports, MLB, NHL, and Warner Bros. Discovery

Industry leaders discuss real-world cloud workflows for live game production, pl...

08/10/2026

Dolby Atmos Coming to Formula 1 on Apple TV Beginning with 2026 U.S. Grand Prix

The next-gen audio technology joins Dolby Vision as part of Apple TV's immersive F1 experience...

08/10/2026

Free Leonard Peltier Proves That the Fight for Justice Is Just Beginning

David France, Jesse Short Bull, Mato Wayuhi, N. Bird Runningwater, Jodi Archambau, Jhane Myers, Paul McGuire, Amber Morning Star Byars, Holly Macarro, Nick Tils...

08/10/2026

Sound Particles update Energy Panner 2 & Brightness Panner 2

Dynamic panning plug-ins get an upgrade Sound Particles have just announced major updates for two of their popular dynamic panning plug-ins. Energy Panner 2...

08/10/2026

The DMNO ON from UDO Audio

New expandable instrument boasts full DMNO engine UDO Audio have just announced the upcoming release of a new, expandable synth that packs the power of the ...

08/10/2026

ADAM Audio introduce the Sub8 PRO & Sub10 PRO

Two new subwoofers added to monitoring line-up ADAM Audio's monitoring range has just been expanded with two new DSP-equipped subwoofers, the Sub8 PRO a...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2026

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

08/10/2026

NAB New York 2026 Preview

Calrec gives broadcasters freedom of choice at NAB Show New York We're looking forward to meeting up with you all at NAB New York on 21st-22nd October. Cal...

08/10/2026

ESPN Unveils First Studio W Refresh

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Pay-TV Operators Ask FCC to Pause TV Station Ownership Cap Rules

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Calrec Brings New Consoles, Software to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Mediagenix Bows AI Content-Aware Scheduling

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Unveil UHK-X700VN Camera at NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ed McGivern Joins USSI Global as Chief Revenue Officer

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Globecast Brings Media Orchestration and C-Band Transitio...

Globecast, a leading provider of broadcast, media and entertainment managed services, will showcase its next generation of media orchestration services at NAB S...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2...

Clear-Com played a critical role in the production communications infrastructure for Rock in Rio 2026, one of the world's largest and most recognized music...

08/10/2026

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Creative Executives

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Crea...

08/10/2026

NAB Show New York Returns to Javits

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

FCC to Vote on Restrictions for Device Testing, Spectrum for D2D and Drones

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

World First' as DTM Deploys Riedel Private 5G for On-Track Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

LiveU Cranks Up Connectivity Across Tour de France

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Introduce New UHK-X700VN Camera at NAB New Yor...

Ikegami announces a major expansion to its range of broadcast-quality live production cameras. Scheduled for introduction on Ikegami booth 708 at NAB New York, ...

08/10/2026

Calrec gives broadcasters freedom of choice at NAB Show...

Calrec will be located at Booth 444. Freedom to choose The media landscape is evolving quickly, and the broadcasters best placed for what comes next will be...

08/10/2026

LiveU LU900Q with LIQ Brings Unprecedented Connectivity t...

LiveU has announced that CRD Audiovisuel relied on LiveUs LU900Q intelligent production unit, with built-in native LiveU IQ (LIQ ) connectivity, to deliver live...

08/10/2026

Disney+ to Stream Super Bowl LXI Live

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Formula 1 U.S. Grand Prix to Be Carried in Dolby Atmos, Dolby Vision on Apple TV

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall to Bring Newest PTZ and POV Cameras to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall Electronics to Showcase Award-winning Camera Sol...

Marshall Electronics, a globally recognized provider of high-performance video solutions for broadcast, streaming, AV and professional production, will exhibit ...

08/10/2026

UKTV acquires first two series of new Maigret for U and U&DRAMA in deal with Banijay Rights

14-hour package also includes A Remarkable Place to Die season 2 as well as libr...