...
Verity API Gateway: The Verity API Gateway receives a video URL request, authenticates the client request and passes the URL to the Verity API.
Verity API: The Verity API passes the request to the Video Transcribe component to orchestrate video transcription and optical character recognition.
Video Transcribe: Video Transcribe downloads the video from the request URL and stores the video. Verity API initiates a transcription job with the transcription service. If the video is in MU38 format it is transcoded prior to transcription. Once the transcription service finishes a job it sends the results back to the object storage service, triggering a notification to the Verity API.Verity API/OCR service:The Service: Downloads video and audio into separate files. The audio file is sent to the transciption service.
Audio Transcribe: The audio file is sent for transcription.
Optical Character Recognition (OCR): Verity API verifies if the audio transcription results contain a sufficient sample of at least 50 words. If not, Verity API requests Video Transcribe to initiate initiates an OCR job. Upon OCR job completion, Verity API receives a notification and retrieves the OCR text results. Verity API passes the
Prism Video Frame Threat Classifier: Video is sent to the Video Threat Classifier for brand safety analysis of video frames.
Verity Text Processing: Verity API passes concatenated text results (comprising transcription, OCR if available, Client metadata title and description) to Verity Tapas Text Processing.Video Frame Sampling: Video frames are sampled at a rate of 1 per second. Verity Text Processing: The Text Processing engine processes the video transcription, OCR, client metadata title and description by applying Natural Language Processing (NLP) for text classification (e.g. IAB Content Categories v2.0 and Threat categories) and information extraction (e.g. Keywords). Verity Image Processing: The Image Processing engine processes the video frame samples by applying Computer Vision (CV) for image classification (e.g. Threat categories).
Verity Report: The Verity API accepts the text analysis results, applies result weighting and merging logic, then returns the final video analysis Verity Report to the client.
...