Get Started With MatrixScan#

With MatrixScan, you can highlight and interact multiple barcodes within the same frame and build AR experiences. MatrixScan use cases are implemented through functionality provided by BarcodeTracking.

In this guide you will learn step by step how to add BarcodeTracking to your application. Roughly, the steps are:

Prerequisites#

Before starting with adding a capture mode, make sure that you have a valid Scandit Data Capture SDK license key and that you added the necessary dependencies. If you have not done that yet, check out this guide.

Note

You can retrieve your Scandit Data Capture SDK license key, by signing in to your account at ssl.scandit.com.

Internal dependencies#

Some of the Scandit Data Capture SDK modules depend on others to work:

Module

Dependencies

ScanditCaptureCore

No dependencies

ScanditBarcodeCapture

  • ScanditCaptureCore

ScanditParser

  • ScanditCaptureCore

ScanditTextCapture

  • ScanditCaptureCore

ScanditIdCapture

  • ScanditCaptureCore

  • ScanditTextCapture (MRZ or VIZ documents)

Create the Data Capture Context#

The first step to add barcode capture capabilities to your application is to create a new data capture context. The context expects a valid Scandit Data Capture SDK license key during construction.

DataCaptureContext context = DataCaptureContext.ForLicenseKey("-- ENTER YOUR SCANDIT LICENSE KEY HERE --");

Configure the Barcode Tracking Mode#

The main entry point for the Barcode Tracking Mode is the BarcodeTracking object. It is configured through BarcodeTrackingSettings and allows to register one or more listeners that will get informed whenever a new frame has been processed.

Most of the times, you will not need to implement a IBarcodeTrackingListener, instead you will add a BarcodeTrackingBasicOverlay and implement a IBarcodeTrackingBasicOverlayListener.

For this tutorial, we will setup Barcode Tracking for tracking QR codes.

BarcodeTrackingSettings settings = BarcodeTrackingSettings.Create();
settings.EnableSymbology(Symbology.Qr, true);

Note

If your scenario is similar to one described in Barcode Tracking Scenarios, then you should consider using BarcodeTrackingSettings.Create() for better results.

Next, create a BarcodeTracking instance with the data capture context and the settings initialized in the previous steps:

BarcodeTracking barcodeTracking = BarcodeTracking.Create(context, settings);

Use the Built-in Camera#

The data capture context supports using different frame sources to perform recognition on. Most applications will use the built-in camera of the device, e.g. the world-facing camera of a device. The remainder of this tutorial will assume that you use the built-in camera.

When using the built-in camera there are recommended settings for each capture mode. These should be used to achieve the best performance and user experience for the respective mode. The following couple of lines show how to get the recommended settings and create the camera from it:

camera = Camera.GetDefaultCamera();
camera?.ApplySettingsAsync(BarcodeTracking.RecommendedCameraSettings);

Because the frame source is configurable, the data capture context must be told which frame source to use. This is done with a call to DataCaptureContext.SetFrameSourceAsync():

context.FrameSource = camera;

The camera is off by default and must be turned on. This is done by calling IFrameSource.SwitchToDesiredState() with a value of FrameSourceState.On:

camera?.SwitchToDesiredStateAsync(FrameSourceState.On);

There is a separate guide for more advanced camera functionality.

Use a Capture View to Visualize the Scan Process#

When using the built-in camera as frame source, you will typically want to display the camera preview on the screen together with UI elements that guide the user through the capturing process. To do that, add a DataCaptureView to your view hierarchy:

DataCaptureView dataCaptureView = DataCaptureView.Create(this, dataCaptureContext);
SetContentView(dataCaptureView);

To visualize the results of Barcode Tracking, first you need to add the following overlay:

BarcodeTrackingBasicOverlay overlay = BarcodeTrackingBasicOverlay.Create(barcodeTracking, dataCaptureView);

Once the overlay has been added, you should implement the IBarcodeTrackingBasicOverlayListener interface. The method IBarcodeTrackingBasicOverlayListener.BrushForTrackedBarcode() is invoked every time a new tracked barcode appears and it can be used to set a brush that will be used to highlight that specific barcode in the overlay.

public Brush BrushForTrackedBarcode(BarcodeTrackingBasicOverlay overlay, TrackedBarcode trackedBarcode)
{
    // Return a custom Brush based on the tracked barcode.
}

If you would like to make the highlights tappable, you need to implement the IBarcodeTrackingBasicOverlayListener.OnTrackedBarcodeTapped() method.

public void OnTrackedBarcodeTapped(BarcodeTrackingBasicOverlay overlay, TrackedBarcode trackedBarcode)
{
    // A tracked barcode was tapped.
}

Get Barcode Tracking Feedback#

Barcode Tracking, unlike Barcode Capture, doesn’t emit feedback (sound or vibration) when a new barcode is recognized. However, you may implement a IBarcodeTrackingListener to provide a similar experience. Below, we use the default Feedback, but you may configure it with your own sound or vibration if you want.

protected override void OnResume()
{
    base.OnResume();
    feedback = Feedback.DefaultFeedback;
}

protected override void OnPause()
{
    base.OnPause();
    feedback.Release();
}

Next, use this feedback in a IBarcodeTrackingListener:

public class FeedbackListener : Java.Lang.Object, IBarcodeTrackingListener
{
    public void OnObservationStarted(BarcodeTracking barcodeTracking)
    {
        // Called when Barcode Tracking is started.
        // We don't use this callback in this guide.
    }

    public void OnObservationStopped(BarcodeTracking barcodeTracking)
    {
        // Called when Barcode Tracking is stopped.
        // We don't use this callback in this guide.
    }

    public void OnSessionUpdated(BarcodeTracking barcodeTracking, BarcodeTrackingSession session, IFrameData frameData)
    {
        if (session.AddedTrackedBarcodes.Any())
        {
            this.feedback.Emit();
        }
    }
}

IBarcodeTrackingListener.OnSessionUpdated() is invoked for every processed frame. The session parameter contains information about the currently tracked barcodes, in particular, the newly recognized ones. We check if there are any and if so, we emit the feedback.

As the last step, register the listener responsible for emitting the feedback with the BarcodeTracking instance.

barcodeTracking.AddListener(feedbackListener);

Disabling Barcode Tracking#

To disable barcode tracking set BarcodeTracking.Enabled to false. The effect is immediate: no more frames will be processed after the change. However, if a frame is currently being processed, this frame will be completely processed and deliver any results/callbacks to the registered listeners. Note that disabling the capture mode does not stop the camera, the camera continues to stream frames until it is turned off.

Limitations#

MatrixScan does not support the following symbologies:

  • DotCode

  • MaxiCode

  • All postal codes (KIX, RM4SCC)

What’s next?

To dive further into the Scandit Data Capture SDK we recommend the following articles: