Object Tracking
 
 
 

If the image sequence you are tracking has multiple moving objects, you can perform object tracking to track these objects relative to the same camera. Since you perform camera tracking first, you can use the camera data generated from the camera tracking analysis. For example, you can perform a camera tracking analysis on the complete scene, then use masks or mattes to perform multiple object tracking passes focusing on various moving objects in the scene. Each result can be converted to separate point clouds or axes, but all results conform to the FBX camera synced to the original camera tracking.

To create an 3D track analysis based on object properties:

  1. Create a camera track analysis, as explained in Camera Tracking.
  2. Click Object Tracking to switch to the Object Tracking menu.
  3. From the Object Motion box, make a selection about the object you are tracking in relation to the camera.
    Select: To:
    Free 3D Motion Track an object moving independently from the camera.
    Orbit Around Cam Track an object rotating around the camera, or far away from the camera.
    Auto Detect Motion Automatically detect the motion type of the object and track accordingly. For small objects, Auto Detect may not be able to establish the proper motion. In this case, select Free 3D Motion or Orbit Around Cam.
  4. Set any needed constraints:
    • Use the Matte Media box to select whether to use a matte for object tracking. If you select to track inside the matte, white areas of the matte are considered for calculating the solution, and black areas are ignored (vice-versa for tracking outside the matte).
    • Use the GMask Option box to select wheter to track inside or outside of an attached GMask node. This option is only available if a GMask node is attached to Analyzer tree. If you used a GMask constraint while camera tracking, the opposite option is automatically selected for object tracking.

    The tracking analysis uses an intersection of the constraints, so you may choose to hide or disconnect gmasks if you want to perform a separate object track for each one.

  5. Enable Forward and Backward to track the image sequence backward after the forward tracking has completed. This option takes longer, but you may get better results.
  6. Set the size of the trackers in the size field.
  7. Click Track.

    Most of the time, tracking occurs in the background, allowing you to continue working while tracking. In Batch, you can use connected input and matte clips as the media to be tracked. If this case, tracking becomes a foreground process.

    You can see a progress indicator beside the Track button. You can interrupt the analysis and resume it by clicking Track again. After tracking has completed and you press Confirm, the Track button changes to Calibrate, and you can see the 2D tracks and 3D points in your image.

Filtering and Adding Trackers

Use the Filter settings to delete lower quality trackers and the Trackers settings manually add and link trackers.

To fine-tune the track analysis:

  1. Use the Quality slider to adjust the number of good trackers kept. The higher the quality setting, more low quality trackers are selected, such as trackers that drift off their initial reference point. Click Delete to delete the selected trackers.

    Trackers of lower quality may hinder the accuracy of the camera tracking.

    NoteAfter you have made a change that requires the 3D tracking analysis to be refined or calibrated, notice that the LED next to the Refine and Calibrate buttons turns yellow. This signifies that a Refine or Calibrate is required, but you do not have to perform it until you have completed your tracker selections.
  2. Adjust the Short slider to select short duration trackers, that is, trackers that only track a feature for a few frames. Click Delete to delete the selected trackers, leaving the longer duration trackers intact.
  3. You can manually select and delete trackers from the image that you feel are not tracking properly. Do one of the following:
    • To select an individual tracker, click the tracker, and then click Delete.
    • To select multiple trackers in the same area, Ctrl-drag a selection box over a series of trackers, and then click Delete.
    • To add another tracker to a multiple selection, Shift-click the tracker, and the click Delete.
    • With Delete mode selected in the Edit Mode box, select trackers in the image.
  4. If you want to add a tracker manually, enable Add and click an area of the image to track from this area automatically.

    A tracker may or may not be added, depending on the ability of the track analysis algorithm to find an appropriate feature to track in this area.

  5. If the analysis creates different trackers that refer to the same feature in the image, you can link these trackers. Press Shift and select two or more trackers from the image, and then click Link.

    For example, an element leaving the scene at frame 28 and returning at frame 50 may result in two different trackers attached to the same element in the image. In this case, select the trackers and click Link to teach the algorithm that these trackers are related to the same feature in the scene.

Setting the Scale

After tracking has occurred, you can set the scale of the tracked object. Since you are tracking a specific object as part of an image, setting the relative scale of the object in relation to the image helps you to position objects in the reconstructed scene when you convert the 3D points into a point cloud or axes.

Refining or Calibrating the Track

Once you are satisfied with your fine tuning changes, you can refine or calibrate your Analyzer.

To refine or calibrate the 3D track:

  1. Depending on the changes you have made, you can choose to refine or calibrate the 3D track. Do one or both of the following:
    • Click Refine.

    The track analysis uses the current results as a starting point, and refines from this point.

    Click Refine again to stop the process once an acceptable pixel error value is reached. The pixel error value is a representation of the distance of the 2D tracks from the computed 3D points.

    TipThe refine process is footage-dependant, so your acceptable pixel error value may change depending on what is tracking. Since the refine process continues until you stop it, as a general rule, if the pixel error value does not change for a length of time (for example, 30 seconds), you can stop the refine process. The lower the pixel error value, the more accurate the reconstructed track is.
    • Click Calibrate.
    NoteThe calibrate operation deletes all previous 3D points and starts over based on the new information. Depending on your footage, and how many trackers you added, deleted, or linked, multiple calibrations may yield different results.

Converting Object Tracking Results

When you are satisfied with the results of the 3D object tracking analysis, you can convert the selected reconstructed points to a point cloud object or actual axes in your scene. The point cloud object is useful because you can easily snap objects to the point cloud.

To create a point cloud object or axes from the 3D object tracking results:

  1. Select the points in the image that you want converted to a point cloud axes. Selected points are displayed as green squares with red crosses.
    TipPress ctrl and draw a rectangle over multiple points to select them. If any points are already selected, they become unselected.
  2. Do one of the following:
    • Click Create Point Cloud

      Selected point are converted to a point cloud object with a parent axis. Double-click the newly created point cloud object to access its menu, where you can change display settings and enable snapping. See xxx.

    • Click Create Axis

      Selected points are converted to axes with a parent axis. The axes synchronize to the results of your 3D camera tracking, and any further changes you make to the 3D track are reflected in these axes.

      NoteIf you want to apply settings manually to a synchronized axis, change its name so that it does not update automatically when 3D Track settings are changed. If you reset the 3D Track settings, the synchronized axes become regular Action axes.
  3. Use the created point cloud or axes to view the reconstructed object motion.

    You can attach objects such as surfaces, 3D text, and 3D models to the new point cloud or axes to help position them in 3D space. See Using the Point Cloud Object.