Skip to content

AI features announced ​

Two gray AI cards sit in the Library Manager and read Coming soon. This page says what they are and where they stand.

Before you start ​

Where you see them ​

Open the Library Manager and look at the panel on the right. The first group is AI-powered, under the line "These tracks include automatic annotation suggestions". Each card there carries an AI badge.

Both cards are pale, and both say Coming soon. You cannot drag them onto your library, and the Add button is not there. No annotation comes from either one yet.

An admin can switch a model on under AI Models. That does not change these 2 cards. The Coming soon badge is fixed in the code, not in the admin page.

The tools that review a suggestion are built already: dashed bars, a green tick, a red cross and an Accept All button. See Review AI suggestions. They stay out of reach until a card loses its badge.

Shot Type Classifier ​

This one is to mark camera shot types down the video. The card says it picks the model that suits your footage: a social-media model for a tall video, a cinema model for a wide one.

Gesture Recognition ​

This one is to find hand gestures, using Google MediaPipe. The card says it knows 7 standard gestures today, and that the research team's own gesture list comes in a later sprint.

What comes after ​

The team keeps a written plan for the next AI work. In the order it proposes:

  1. Body, hand and face points, which serve gesture and head movement at once.
  2. Telling speakers apart in the sound.
  3. A plain description of facial movement.
  4. Where a person looks.
  5. Shot type.

That order can change. It is a plan for discussion, not a promise of dates.

Check it worked ​

Nothing to do. When a card loses its Coming soon badge, you can drag it onto a track.

If something goes wrong ​