Get Started with Video Labeler 

 September 24, 2021

By  Abhishek Tyagi


Object recognition and pursuit are among the foremost everyday and sophisticated tasks that robotic sensing systems should perform to support complex psychological feature tasks that love distinguishing between events and actions. The goal of seeing is to establish the object's gift within the 3D scene accurately. This is a difficult task as the scene could be cluttered, objects obscuring each other, and there could also be lighting or different angles. Object and position recognition is essential in several sensible applications such as industrial plant automation, navigation, vehicles, elements inspection, CAD / CAM, etc. Our primary interest is in object recognition for autonomous vehicles applications in a road environment in this report. We are monitoring people, robots, cars, and pedestrians. We want to observe people and these objects to improve the performance and safety of vehicles, so vehicles and similar systems can interact with their environment. We emphasize Position, movement, pose, and classification data to determine if a person is crossing the street or a specific car is on the move.

For this application, we will be using the inbuilt Video Labeler App in MATLAB. This app facilitates us by creating labels around the region of interest. And the data produced by this app can be used for training algorithms such as object detectors, image classifiers, etc.

Importing Data

 Label video for computer vision applications. You can import data sources in the form of video, image sequence, and custom reader. Video labeler also provides us with the advantage of importing labels and label definitions.



 After importing, start by navigating to the required frames or select the portion of the video. Now define the type of label you intend to draw. It can be a rectangle, polygon, line, pixel, or projected cuboid. Click on Add labels, enter a name, select the type, color, group, and description. After that, you can choose a region of interest by clicking and dragging over the region. You can also create sub-labels, attributes, and scene labels.




It is a label that belongs to the parent label. They are used for more detailing and can be created by clicking on the sublabel. Follow the same steps as while adding a label. For example, a man is a label whose features like eyes and nose can be sub-labels.


It specifies additional information about labels or sub-labels. For example- A man's height can be an attribute. It can be defined in following types:

Numeric Value — Specify a numeric scalar attribute

String — Specify a string scalar attribute

Logical — Specify a logical true or false attribute

List — Specify a drop-down list attribute of predefined strings

To add an attribute, click on Add Attribute and fill in the information.

Scene Label

This option greatly benefits adding environment/scene additional information such as events in the background. Click on Scene Label, then provide name, group description, and colour optionally. It can be added to a frame or to a time interval.

Video Labeler

As of now, we have labelled a single frame of our video. Now we can proceed in two ways, either manually or using an algorithm for automation:

This method is introduced to make our labelling process much more manageable. In this, we make an algorithm do the labelling for us, either for a time interval or complete video. We can create our algorithms or can use inbuilt ones. You can use this method by selecting predefined labels or sub-labels, select the automation algorithm from the Automatic Labeling group present. Choose a suitable algorithm or create one. Select the required time interval for which you want to do labelling and click on Automate option available right of the particular algorithm. Respective instructions will appear on the right side of the canvas. Click on Run to run the labelled video. When looking at the labelled video, click on Accept or alter manually until you get the specified outcome if you're happy with the result. For example, suppose the video is missing a few frames. In that case, add manually or the size of labels is not up to mark, change manually.

Labelling Manually

This is a challenging but efficient method for labelling. In this, you must create labels, sub-labels, attributes in each frame individually. It will not carry this information from one frame to another.

Labelling with Automation Algorithms



After completing your work, you can use the View Label Summary option to see label frequency, scene labels, and many other things.

Exporting Data

 Now our model is working fine and wants to export data outside the Video Labeler App. Video Labeler App provides us with two ways to export our data, 1- Saving into MAT- file and 2- Export as variable into MATLAB workspace. Data will be stored as groundTruth objects in both ways and can train deep learning models.



We have completed importing data, acting on it, and at last, exporting it to Workspace. in a while, we have trained the model and tested it, which ends in 1.0 precision. It's prompt to use labels with correct form and sizes; otherwise, it'll lack accuracy.

Get instant access to the code, model, or application of the video or article you found helpful! Simply purchase the specific title, if available, and receive the download link right away! #MATLABHelper #CodeMadeEasy

Ready to take your MATLAB skills to the next level? Look no further! At MATLAB Helper, we've got you covered. From free community support to expert help and training, we've got all the resources you need to become a pro in no time. If you have any questions or queries, don't hesitate to reach out to us. Simply post a comment below or send us an email at [email protected].

And don't forget to connect with us on LinkedIn, Facebook, and Subscribe to our YouTube Channel! We're always sharing helpful tips and updates, so you can stay up-to-date on everything related to MATLAB. Plus, if you spot any bugs or errors on our website, just let us know and we'll make sure to fix it ASAP.

Ready to get started? Book your expert help with Research Assistance plan today and get personalized assistance tailored to your needs. Or, if you're looking for more comprehensive training, join one of our training modules and get hands-on experience with the latest techniques and technologies. The choice is yours – start learning and growing with MATLAB Helper today!

Education is our future. MATLAB is our feature. Happy MATLABing!

Original Image

Original Image

Filtered Image

Filtered Image

Yellow Mask

Yellow Mask

White Mask

White Mask

About the author 

Abhishek Tyagi

Abhishek Tyagi is an aspiring Automotive engineer who enjoys connecting the dots: be it ideas from different disciplines, people from different teams, or applications from different industries. He has strong technical skills and an academic background in engineering, statistics, and machine learning.

{"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}

MATLAB Helper ®

Follow: YouTube Channel, LinkedIn Company, Facebook Page, Instagram Page

Join Community of MATLAB Enthusiasts: Facebook Group, Telegram, LinkedIn Group

Use Website Chat or WhatsApp at +91-8104622179