illustration of livestream on computer monitor
An arrow pointing leftHome

CLIPr is bringing its ‘snackable’ AI video analysis to livestreams

  • Mike Pearl

Tech for skipping through boring videos comes to boring livestreams.

CLIPr, a small Seattle-based AI startup led by CEO Humphrey Chen, a former manager of AWS’s facial recognition project, has expanded the versatility of its “video analysis and management” product. Namely, it’s bringing its functionality to livestreams.

This bodes well for reluctant viewers of COVID-era board meetings and keynotes who have had to sit through a whole video stream just to see one person speak or hear about one relevant topic. And that’s pretty much everyone, right?

CLIPr’s main value proposition was previously pretty narrow and straightforward: CLIPr uses AI to transcribe and then essentially annotate spoken word videos, neatly organizing these notes into a sidebar that works like a clickable table of contents.

Streaming video sites like YouTube have, for many years, had a similar feature available as an option, but it typically requires painstaking manual note-taking, time-stamping and labeling in order to be made available to the viewer. By transcribing videos and using its AI to deduce main topics and subtopics, CLIPr makes the same option available without all the work.

So now, CLIPr can process livestreams too.

While, no, the AI can’t crunch the data from a partial speech, and then use a transformer to guess what the rest of it will be so the viewer can jump ahead, it can index the live event as it happens so the CLIPr topics and subtopics will be available soon after it’s over.

As a second layer of functionality, CLIPr now allows viewers (or virtual meeting attendees) to react, a-la Twitch or Instagram Live — posting reaction emojis or adding comments. The new, more social features provide a window into what CLIPr would look like as a side-by-side competitor with one of the major platforms.

In a press release, Chen notes that CLIPr “can serve as an engagement bridge to enriched video libraries without the need to separately record and ingest video.” By expanding its product’s potential applications, CLIPr is making a bid for the attention of a massive user base. Twitch alone has about 7.5 million active streamers, and that’s just one service.

Additionally, apart from transcribing and indexing livestreams, CLIPRr’s core product could be useful to journalists, archivists and even reality TV editors. If it were, hypothetically, acquired by one of the companies that already serves these markets, the value to users in time saved is potentially immense.

Currently CLIPr’s website and press materials emphasize one application: broadcasting business events like keynotes. But as Chen points out, CLIPr has wider potential applications in a world stuck watching a lot of video content for any number of reasons, and that CLIPr “combats ‘video fatigue’ and supports the shifting preference for consuming long-form video content by making it more snackable.”