.st0{fill:#FFFFFF;}

Get Started with Video Labeler 

 September 24, 2021

By  Abhishek Tyagi

Introduction

Object recognition and pursuit are among the foremost everyday and sophisticated tasks that robotic sensing systems should perform to support complex psychological feature tasks that love distinguishing between events and actions. The goal of seeing is to establish the object's gift within the 3D scene accurately. This is a difficult task as the scene could be cluttered, objects obscuring each other, and there could also be lighting or different angles. Object and position recognition is essential in several sensible applications such as industrial plant automation, navigation, vehicles, elements inspection, CAD / CAM, etc. Our primary interest is in object recognition for autonomous vehicles applications in a road environment in this report. We are monitoring people, robots, cars, and pedestrians. We want to observe people and these objects to improve the performance and safety of vehicles, so vehicles and similar systems can interact with their environment. We emphasize Position, movement, pose, and classification data to determine if a person is crossing the street or a specific car is on the move.

For this application, we will be using the inbuilt Video Labeler App in MATLAB. This app facilitates us by creating labels around the region of interest. And the data produced by this app can be used for training algorithms such as object detectors, image classifiers, etc.

Importing Data

 Label video for computer vision applications. You can import data sources in the form of video, image sequence, and custom reader. Video labeler also provides us with the advantage of importing labels and label definitions.
Import

Import

Labelling

 After importing, start by navigating to the required frames or select the portion of the video. Now define the type of label you intend to draw. It can be a rectangle, polygon, line, pixel, or projected cuboid. Click on Add labels, enter a name, select the type, color, group, and description. After that, you can choose a region of interest by clicking and dragging over the region. You can also create sub-labels, attributes, and scene labels.

Label

Label

Sublabels

It is a label that belongs to the parent label. They are used for more detailing and can be created by clicking on the sublabel. Follow the same steps as while adding a label. For example, a man is a label whose features like eyes and nose can be sub-labels.

Attributes

It specifies additional information about labels or sub-labels. For example- A man's height can be an attribute. It can be defined in following types:

Numeric Value — Specify a numeric scalar attribute

String — Specify a string scalar attribute

Logical — Specify a logical true or false attribute

List — Specify a drop-down list attribute of predefined strings

To add an attribute, click on Add Attribute and fill in the information.

Scene Label

This option greatly benefits adding environment/scene additional information such as events in the background. Click on Scene Label, then provide name, group description, and colour optionally. It can be added to a frame or to a time interval.

Video Labeler

As of now, we have labelled a single frame of our video. Now we can proceed in two ways, either manually or using an algorithm for automation:

This method is introduced to make our labelling process much more manageable. In this, we make an algorithm do the labelling for us, either for a time interval or complete video. We can create our algorithms or can use inbuilt ones. You can use this method by selecting predefined labels or sub-labels, select the automation algorithm from the Automatic Labeling group present. Choose a suitable algorithm or create one. Select the required time interval for which you want to do labelling and click on Automate option available right of the particular algorithm. Respective instructions will appear on the right side of the canvas. Click on Run to run the labelled video. When looking at the labelled video, click on Accept or alter manually until you get the specified outcome if you're happy with the result. For example, suppose the video is missing a few frames. In that case, add manually or the size of labels is not up to mark, change manually.

Labelling Manually

This is a challenging but efficient method for labelling. In this, you must create labels, sub-labels, attributes in each frame individually. It will not carry this information from one frame to another.

Labelling with Automation Algorithms

Algorithms

Algorithms

After completing your work, you can use the View Label Summary option to see label frequency, scene labels, and many other things.

Exporting Data

 Now our model is working fine and wants to export data outside the Video Labeler App. Video Labeler App provides us with two ways to export our data, 1- Saving into MAT- file and 2- Export as variable into MATLAB workspace. Data will be stored as groundTruth objects in both ways and can train deep learning models.
Export

Export

Conclusion

We have completed importing data, acting on it, and at last, exporting it to Workspace. in a while, we have trained the model and tested it, which ends in 1.0 precision. It's prompt to use labels with correct form and sizes; otherwise, it'll lack accuracy.

Did you find some helpful content from our video or article and now looking for its code, model, or application? You can purchase the specific Title, if available, and instantly get the download link.

Thank you for reading this blog. Do share this blog if you found it helpful. If you have any queries, post them in the comments or contact us by emailing your questions to [email protected]. Follow us on LinkedIn Facebook, and Subscribe to our YouTube Channel. If you find any bug or error on this or any other page on our website, please inform us & we will correct it.

If you are looking for free help, you can post your comment below & wait for any community member to respond, which is not guaranteed. You can book Expert Help, a paid service, and get assistance in your requirement. If your timeline allows, we recommend you book the Research Assistance plan. If you want to get trained in MATLAB or Simulink, you may join one of our training modules. 

If you are ready for the paid service, share your requirement with necessary attachments & inform us about any Service preference along with the timeline. Once evaluated, we will revert to you with more details and the next suggested step.

Education is our future. MATLAB is our feature. Happy MATLABing!

Original Image

Original Image

Filtered Image

Filtered Image

Yellow Mask

Yellow Mask

White Mask

White Mask

About the author 

Abhishek Tyagi

Abhishek Tyagi is an aspiring Automotive engineer who enjoys connecting the dots: be it ideas from different disciplines, people from different teams, or applications from different industries. He has strong technical skills and an academic background in engineering, statistics, and machine learning.

{"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}

Connect with MATLAB Helper ®

Follow: YouTube Channel, LinkedIn Company, Facebook Page, Instagram Page

Join Community of MATLAB Enthusiasts: Facebook Group, Telegram, LinkedIn Group

Use Website Chat or WhatsApp at +91-8104622179

Watch our Latest Video

Join a Training Module

MATLAB Helper Training
>