Convert x y w h to top left roght bottom năm 2024
Bounding boxes are rectangles that mark objects on an image. There are multiple formats of bounding boxes annotations. Each format uses its specific representation of bouning boxes coordinates. Albumentations supports four formats: Show
3,
4,
5, and
6 . Let's take a look at each of those formats and how they represent coordinates of bounding boxes. As an example, we will use an image from the dataset named Common Objects in Context. It contains one bounding box that marks a cat. The image width is 640 pixels, and its height is 480 pixels. The width of the bounding box is 322 pixels, and its height is 117 pixels. The bounding box has the following
7 coordinates of its corners: top-left is
8 or
9, top-right is
0 or
1, bottom-left is
2 or
3, bottom-right is
4 or
5. As you see, coordinates of the bounding box's corners are calculated with respect to the top-left corner of the image which has
7 coordinates
7. An example image with a bounding box from the COCO datasetpascal_voc
3 is a format used by the Pascal VOC dataset. Coordinates of a bounding box are encoded with four values in pixels:
9.
0 and
1 are coordinates of the top-left corner of the bounding box.
2 and
3 are coordinates of bottom-right corner of the bounding box. Coordinates of the example bounding box in this format are
4. albumentations
4 is similar to
3, because it also uses four values
9 to represent a bounding box. But unlike
3,
4 uses normalized values. To normalize values, we divide coordinates in pixels for the x- and y-axis by the width and the height of the image. Coordinates of the example bounding box in this format are
0 which are
1. Albumentations uses this format internally to work with bounding boxes and augment them. coco
5 is a format used by the Common Objects in Context COCO dataset. In
5, a bounding box is defined by four values in pixels
4. They are coordinates of the top-left corner along with the width and height of the bounding box. Coordinates of the example bounding box in this format are
5. yoloIn
6, a bounding box is represented by four values
7.
8 and
9 are the normalized coordinates of the center of the bounding box. To make coordinates normalized, we take pixel values of x and y, which marks the center of the bounding box on the x- and y-axis. Then we divide the value of x by the width of the image and value of y by the height of the image.
0 and
1 represent the width and the height of the bounding box. They are normalized as well. Coordinates of the example bounding box in this format are
2 which are
3. How different formats represent coordinates of a bounding boxBounding boxes augmentationJust like with images and masks augmentation, the process of augmenting bounding boxes consists of 4 steps.
Note Some transforms in Albumentation don't support bounding boxes. If you try to use them you will get an exception. Please refer to this article to check whether a transform can augment bounding boxes. Step 1. Import the required libraries.
Step 2. Define an augmentation pipeline.Here an example of a minimal declaration of an augmentation pipeline that works with bounding boxes.
Note that unlike image and masks augmentation,
4 now has an additional parameter
5. You need to pass an instance of
6 to that argument.
6 specifies settings for working with bounding boxes.
8 sets the format for bounding boxes coordinates. It can either be
3,
4,
5 or
6. This value is required because Albumentation needs to know the coordinates' source format for bounding boxes to apply augmentations correctly. Besides
8,
6 supports a few more settings. Here is an example of
4 that shows all available settings with
6:
7 and
8
7 and
8 parameters control what Albumentations should do to the augmented bounding boxes if their size has changed after augmentation. The size of bounding boxes could change if you apply spatial augmentations, for example, when you crop a part of an image or when you resize an image.
7 is a value in pixels. If the area of a bounding box after augmentation becomes smaller than
7, Albumentations will drop that box. So the returned list of augmented bounding boxes won't contain that bounding box.
8 is a value between 0 and 1. If the ratio of the bounding box area after augmentation to
4 becomes smaller than
8, Albumentations will drop that box. So if the augmentation process cuts the most of the bounding box, that box won't be present in the returned list of the augmented bounding boxes. Here is an example image that contains two bounding boxes. Bounding boxes coordinates are declared using the
5 format. An example image with two bounding boxesFirst, we apply the
7 augmentation without declaring parameters
7 and
8. The augmented image contains two bounding boxes. An example image with two bounding boxes after applying augmentationNext, we apply the same
7 augmentation, but now we also use the
7 parameter. Now, the augmented image contains only one bounding box, because the other bounding box's area after augmentation became smaller than
7, so Albumentations dropped that bounding box. An example image with one bounding box after applying augmentation with 'min_area'Finally, we apply the
7 augmentation with the
8. After that augmentation, the resulting image doesn't contain any bounding box, because visibility of all bounding boxes after augmentation are below threshold set by
8. An example image with zero bounding boxes after applying augmentation with 'min_visibility'Class labels for bounding boxesBesides coordinates, each bounding box should have an associated class label that tells which object lies inside the bounding box. There are two ways to pass a label for a bounding box. Let's say you have an example image with three objects:
6,
7, and
8. Bounding boxes coordinates in the
5 format for those objects are
0,
1, and
2. An example image with 3 bounding boxes from the COCO dataset1. You can pass labels along with bounding boxes coordinates by adding them as additional values to the list of coordinates.For the image above, bounding boxes with class labels will become
3,
4, and
5. Class labels could be of any type: integer, string, or any other Python data type. For example, integer values as class labels will look the following:
6,
7, and
8 Also, you can use multiple class values for each bounding box, for example
9,
00, and
01. 2.You can pass labels for bounding boxes as a separate list (the preferred way).For example, if you have three bounding boxes like
0,
1, and
2 you can create a separate list with values like
05, or
06 that contains class labels for those bounding boxes. Next, you pass that list with class labels as a separate argument to the
07 function. Albumentations needs to know the names of all those lists with class labels to join them with augmented bounding boxes correctly. Then, if a bounding box is dropped after augmentation because it is no longer visible, Albumentations will drop the class label for that box as well. Use
08 parameter to set names for all arguments in
07 that will contain label descriptions for bounding boxes (more on that in Step 4). Step 3. Read images and bounding boxes from the disk.Read an image from the disk.
Bounding boxes can be stored on the disk in different serialization formats: JSON, XML, YAML, CSV, etc. So the code to read bounding boxes depends on the actual format of data on the disk. After you read the data from the disk, you need to prepare bounding boxes for Albumentations. Albumentations expects that bounding boxes will be represented as a list of lists. Each list contains information about a single bounding box. A bounding box definition should have at list four elements that represent the coordinates of that bounding box. The actual meaning of those four values depends on the format of bounding boxes (either
3,
4,
5, or
6). Besides four coordinates, each definition of a bounding box may contain one or more extra values. You can use those extra values to store additional information about the bounding box, such as a class label of the object inside the box. During augmentation, Albumentations will not process those extra values. The library will return them as is along with the updated coordinates of the augmented bounding box. Step 4. Pass an image and bounding boxes to the augmentation pipeline and receive augmented images and boxes.As discussed in Step 2, there are two ways of passing class labels along with bounding boxes coordinates: 1. Pass class labels along with coordinates.So, if you have coordinates of three bounding boxes that look like this:
you can add a class label for each bounding box as an additional element of the list along with four coordinates. So now a list with bounding boxes and their coordinates will look the following:
or with multiple labels per each bounding box:
You can use any data type for declaring class labels. It can be string, integer, or any other Python data type. Next, you pass an image and bounding boxes for it to the
07 function and receive the augmented image and bounding boxes.
2. Pass class labels in a separate argument to
07 (the preferred way). Let's say you have coordinates of three bounding boxes
You can create a separate list that contains class labels for those bounding boxes:
Then you pass both bounding boxes and class labels to
07. Note that to pass class labels, you need to use the name of the argument that you declared in
08 when creating an instance of Compose in step 2. In our case, we set the name of the argument to
18.
0 Example input and output data for bounding boxes augmentation with a separate argument for class labelsNote that
08 expects a list, so you can set multiple fields that contain labels for your bounding boxes. So if you declare Compose like What is Xywh format?The xywh() CSS function creates a rectangle using the specified distances from the left ( x ) and top ( y ) edges of the containing block and the specified width ( w ) and height ( h ) of the rectangle. It is a basic shape function of the How to convert bounding box x1 y1 x2 y2 to yolo style?To convert between your (x, y) coordinates and yolo (u, v) coordinates you need to transform your data as u = x / XMAX and y = y / YMAX where XMAX , YMAX are the maximum coordinates for the image array you are using. This all depends on the image arrays being oriented the same way. How do you normalize a bounding box coordinate?To normalize values, we divide coordinates in pixels for the x- and y-axis by the width and the height of the image. Coordinates of the example bounding box in this format are [98 / 640, 345 / 480, 420 / 640, 462 / 480] which are [0.153125, 0.71875, 0.65625, 0.9625] . What is the format for bounding box coordinates?These bounding box coordinates are usually in the format of (xmin, ymin, xmax, ymax). With these coordinates, you can easily calculate the width and height of the detected object. |