updating the stream summary by:
adding to the stream summary each non-incumbent frame selected;
adding to the stream summary a coverage score associated with each non-incumbent
frame selected; scoring each non-incumbent frame by:
computing a feature vector for each frame in the set;
computing a non-incumbent coverage score, based on the feature vectors, for each
frame in the set with respect to the other frames in the set; and computing a 2D diversity matrix, based on the feature vectors, the matrix including a
diversity score for each frame in the in the set with respect to the other frames
in the set and with respect to each incumbent frame; and selecting one or more frame by:
computing a coverage vector by joining the non-incumbent coverage scores with the
stored coverage scores; solving an objective function including the coverage vector and the diversity matrix
for an optimization vector having the maximum diversity score and
maximum coverage score; and selecting the non-incumbent frames and incumbent frames identified by the
optimization vector.
19. The media of claim 17, wherein the feature vector is based on histograms of oriented
gradient (HOG); computing the non-incumbent coverage score comprises determining a coverage vector
including a maximum value of a similarity metric for each frame in the new set; and computing the diversity score comprises determining a 2D diversity matrix comprising the
distance between color histograms for pairings of all frames in the pool.
20. The media of claim 17, further comprising instructions which when executed cause the
system to perform the method further comprising: storing, to a secondary memory, each frame and associated coverage value removed from a
stream summary slot; performing a secondary selection of frames, from a pool of frames including those
associated with the summary frame slots and those stored to the secondary memory,

based on a solution to the objective function that optimizes the frame scoring for a predetermined number of slots of a secondary stream summary; and storing the frames from the secondary selection to the memory.