Video and audio analysis

ONNX Runtime

@vionvision/camera-ui-onnxv1.7.7

Add object and face analysis, number plate reading and frame content analysis. Choose the option for your hardware.

Version
1.7.7
Updated
October 18, 2026
Requires
ViON 2.4.2 or newer
Licence
MIT
Group
Video and audio analysis

Technical description

Detects objects, faces and license plates in the camera image and makes recordings searchable by description. It runs on an NVIDIA graphics card or, without one, on the processor.

What it does

  • Object detection: people, vehicles and animals
  • Face detection and face recognition
  • Finds license plates and reads their text
  • AI search by description; with the multilingual model also in Russian and about 100 other languages
  • Finds people who look alike across cameras (Person Re-ID, switched on per camera) and outlines people, vehicles and animals (segmentation)
  • Uses a detector that ViON Cloud trained on the footage you reviewed, once it is published
  • Answers yes/no questions it was trained for about a detected object, for example "person with a bag"
  • Can use several NVIDIA graphics cards at once

What you need

  • Linux or Windows
  • For an NVIDIA graphics card: CUDA 13, cuDNN 9 for CUDA 13 and NVIDIA driver 580 or newer
  • For NVIDIA cards older than the GTX 1650 (Maxwell, Pascal, Volta) or systems staying on CUDA 12, use the ONNX Legacy plugin instead

Settings

  • "Execution Provider": 'auto' uses CUDA on Linux and Windows (x86_64), otherwise the processor; with 'tensorrt' (NVIDIA TensorRT) the first start takes longer. If it fails, the processor takes over.
  • "CUDA Device IDs": which graphics cards to use, for example "0,1"
  • "CLIP Model (Images)": the AI search model for all cameras. After changing it, reindex the recordings.
  • "Face Recognition Model": one model for all cameras. After a change the saved faces are processed again.
  • Per camera: the models for object detection, face detection and license plates. "Default" follows the recommended model.

Other extensions in this group