Deep Learning and Video — Dealing with the Overhead
So you’ve got an AI thing that you’re doing with video. Fun, right? Probably involves cats. In fact, it’s probably something like “ GANs to locate and identify Cats on TV shows ”, and is going to end up being demoed at https://cats_on_friends.io Thing is, as you’re going down this road, at some point you’re going to have to train your model, and that is going to involve a s**t-ton of video. Video that is, by definition, data-heavy — all those 30 minute episodes at 720p add up. What’s worse is that you’re likely to randomly sample these video clips, a minute here, a minute there, and so on. Video Codecs and Compression Wait, you know how video codecs works, right? They, effectively, store the whole screen every now and then, with all the stuff between these screenshots just being the data that changed between these screenshots. These screenshots are called keyframes or intra-frames , and when you want to work with a video segment at time 2:11, what you ac...