v0.6 Beta - NVIDIA GTC April 2021 Release

Update to v0.6 Beta

CMakeLists.txt

@@ -1,4 +1,4 @@
-cmake_minimum_required(VERSION 3.12.0)
+cmake_minimum_required(VERSION 3.10)
 
 # Set path where samples will be installed
 set(CMAKE_INSTALL_PREFIX ${CMAKE_SOURCE_DIR} CACHE PATH "Path to where the samples will be installed")
@@ -9,7 +9,7 @@ project(NvVideoEffects_SDK CXX)
 set(CMAKE_CONFIGURATION_TYPES "Release")
 
 # Require C++11 and disable non-standard extensions
-set(CMAKE_CXX_STANDARD 14)
+set(CMAKE_CXX_STANDARD 11)
 set(CMAKE_CXX_STANDARD_REQUIRED ON)
 set(CMAKE_CXX_EXTENSIONS OFF)
 
@@ -19,12 +19,47 @@ add_definitions(-DNOMINMAX -DWIN32_LEAN_AND_MEAN)
 set(CMAKE_ARCHIVE_OUTPUT_DIRECTORY ${CMAKE_BINARY_DIR})
 set(CMAKE_LIBRARY_OUTPUT_DIRECTORY ${CMAKE_BINARY_DIR})
 set(CMAKE_RUNTIME_OUTPUT_DIRECTORY ${CMAKE_BINARY_DIR})
+set(CMAKE_MODULE_PATH "${PROJECT_SOURCE_DIR}/cmake" ${CMAKE_MODULE_PATH})
 
-set(SDK_INCLUDES_PATH ${CMAKE_CURRENT_SOURCE_DIR}/nvvfx/include)
-# Add target for NVVideoEffects
-add_library(NVVideoEffects INTERFACE)
-target_include_directories(NVVideoEffects INTERFACE ${SDK_INCLUDES_PATH})
+if(MSVC)
 
-set(ENABLE_SAMPLES TRUE)
-add_subdirectory(samples)
+    set(SDK_INCLUDES_PATH ${CMAKE_CURRENT_SOURCE_DIR}/nvvfx/include)
+    # Add target for NVVideoEffects
+    add_library(NVVideoEffects INTERFACE)
+    target_include_directories(NVVideoEffects INTERFACE ${SDK_INCLUDES_PATH})
+
+else()
+    # Add target for NVVideoEffects
+    add_library(NVVideoEffects INTERFACE)
+
+    # found in different locations depending on type of package
+    find_path(VideoFX_INCLUDES
+        NAMES nvVideoEffects.h
+        PATHS
+        /usr/local/VideoFX/include
+        /usr/include/x86_64-linux-gnu
+        /usr/include
+        REQUIRED
+        )
+
+    target_include_directories(NVVideoEffects INTERFACE ${VideoFX_INCLUDES})
+    set(SDK_INCLUDES_PATH ${VideoFX_INCLUDES})
+
+    find_library(VideoFX_LIB
+        NAMES libVideoFX.so
+        PATHS
+        /usr/local/VideoFX/lib
+        /usr/lib/x86_64-linux-gnu
+        /usr/lib64
+        /usr/lib
+        REQUIRED
+        NO_DEFAULT_PATH)
 
+    target_link_libraries(NVVideoEffects INTERFACE "${VideoFX_LIB}")
+
+    message(STATUS "VideoFX_LIB: ${VideoFX_LIB}")
+    message(STATUS "SDK_INCLUDES_PATH: ${SDK_INCLUDES_PATH}")
+
+endif()
+
+add_subdirectory(samples)

LICENSE

@@ -1,6 +1,6 @@
 The MIT License (MIT)
 
-Copyright (c) 2020 NVIDIA Corporation
+Copyright (c) 2021 NVIDIA Corporation
 
 Permission is hereby granted, free of charge, to any person obtaining a copy of
 this software and associated documentation files (the "Software"), to deal in

README.MD

@@ -1,55 +1,64 @@
 # README
-## NVIDIA VideoEffects SDK: API Source Code and Sample Applications
+## NVIDIA MAXINE VideoEffects SDK: API Source Code and Sample Applications
 
-NVIDIA VideoEffects SDK is an SDK for enhancing and applying filters to videos at real-time. The SDK is powered by NVIDIA graphics processing units (GPUs) with Tensor Cores, and as a result, the algorithm throughput is greatly accelerated, and latency is reduced.
+NVIDIA MAXINE VideoEffects SDK is an SDK for enhancing and applying filters to videos at real-time. The SDK is powered by NVIDIA graphics processing units (GPUs) with Tensor Cores, and as a result, the algorithm throughput is greatly accelerated, and latency is reduced.
 
-NVIDIA VideoEffects SDK has the following AI features:
+The SDK has the following AI features:
 
+- **AI Green Screen**, which segments and masks the background areas in a video or image.
+- **Background Blur**, which uses the segmentation mask from the AI Green Screen filter or other sources, and produces a blur effect over the background of a video or iamge.
 - **Encoder Artifact Reduction**, which reduces the blocky and noisy artifacts from an encoded video while preserving the details of the original video.
 - **Super Resolution**, which upscales a video while also reducing the blocky and noisy artifacts. It can enhance the details and sharpen the output while simultaneously preserving the content. This is suitable for upscaling lossy content.
 - **Upscale**, which is a very fast and light-weight method for upscaling an input video. It also provides a sharpening parameter to sharpen the resulting output. This feature can be optionally pipelined with the encoder artifact reduction feature to enhance the scale while reducing the video artifacts.
+- **Webcam Denoising**, which removes noise from a webcam video while preserving the texture details.
 
 <p align="center">
-<img src="https://github.com/NVIDIA/BROADCAST-VFX-SDK/blob/master/resources/superres.gif" alt="NVIDIA Super Resolution" width="640" height="320"/>
+<img src="https://github.com/NVIDIA/MAXINE-VFX-SDK/blob/master/resources/SR.gif" alt="NVIDIA Super Resolution" width="640" height="320"/>
  </p>
 
-NVIDIA VideoEffects SDK provides two sample applications that demonstrate the features listed above in real time by using offline videos.
-- **VideoEffects App**, which is a sample app that can invoke each feature individually.
+<p align="center">
+<img src="https://github.com/NVIDIA/MAXINE-VFX-SDK/blob/master/resources/Denoise.gif" alt="NVIDIA Webcam Denoising" width="640" height="320"/>
+ </p>
+
+The SDK provides several sample applications that demonstrate the features listed above in real time by using offline videos.
+- **AI Green Screen App**, which is a sample app that demonstrates the background segmentation feature.
+- **VideoEffects App**, which is a sample app that can invoke each of Encoder Artifact Reduction, Super Resolution or Upscale features individually.
 - **UpscalePipeline App**, which is a sample app that pipelines the Encoder Artifact Reduction feature with the Upscale feature.
+- **DenoiseEffect App**, which is a sample app that demonstrates the webcam denoising feature.
 
-All features in the VideoEffects SDK support 720p and 1080p as input resolutions. These are the scaling factors supported by the Super Resolution feature:
-- **720p inputs** can be scaled by a factor of 1.5x or 2x.
-- **1080p inputs** can be scaled by a factor of 4/3x (~1.33x) or 2x.
-
-Additionally, the Upscale feature supports any input resolution, and the following scaling factors:
-- 4/3x (~1.33x), 1.5x, 2x or 3x  
+The input and output resolutions supported by the features of the SDK are listed below.
+- The Super Resolution and Encoder Artifact Reduction features support between 90p to 1080p as input resolutions. 
+   - Super Resolution supports the following scaling factors: 4/3x (~1.33x), 1.5x, 2x, 3x and 4x.
+   - The maximum output resolution for the Super Resolution feature is 2160p.
+- The Upscale feature supports any input resolution, and the following scaling factors: 4/3x (~1.33x), 1.5x, 2x, 3x  and 4x.
+- The Webcam Denoising feature supports between 80p to 1080p as input resolutions.
+- The AI Green Screen and Background Blur features require that an input image/video be at least 288 pixels high.
 
-NVIDIA VideoEffects SDK is distributed in the following parts:
+NVIDIA MAXINE VideoEffects SDK is distributed in the following parts:
 
-- This open source repository that includes the [SDK API and proxy linking source code](https://github.com/NVIDIA/BROADCAST-VFX-SDK/tree/master/nvvfx), and [sample applications and their dependency libraries](https://github.com/NVIDIA/BROADCAST-VFX-SDK/tree/master/samples).
-- An installer hosted on [RTX broadcast engine developer page](https://developer.nvidia.com/rtx-broadcast-engine) that installs the SDK DLLs, the models, and the SDK dependency libraries.
+- This open source repository that includes the [SDK API and proxy linking source code](https://github.com/NVIDIA/MAXINE-VFX-SDK/tree/master/nvvfx), and [sample applications and their dependency libraries](https://github.com/NVIDIA/MAXINE-VFX-SDK/tree/master/samples).
+- An installer hosted on [NVIDIA Maxine developer page](https://www.nvidia.com/broadcast-sdk-resources) that installs the SDK DLLs, the models, and the SDK dependency libraries.
 
-Please refer to [SDK programming guide](https://github.com/NVIDIA/BROADCAST-VFX-SDK/blob/master/docs/NVIDIA%20Video%20Effects%20SDK%20Programming%20Guide.pdf) for configuring and integrating the SDK, compiling and running the sample applications.
+Please refer to [SDK programming guide](https://github.com/NVIDIA/MAXINE-VFX-SDK/blob/master/docs/NVIDIA%20Video%20Effects%20SDK%20Programming%20Guide.pdf) for configuring and integrating the SDK, compiling and running the sample applications. Please visit the [NVIDIA MAXINE Video Effects SDK](https://developer.nvidia.com/maxine-getting-started) webpage for more information about the SDK.
 
 ## System requirements
-The SDK is supported on NVIDIA GPUs that are based on the NVIDIA® Turing™ architecture. Although the SDK can run on Turing™ GPUs without Tensor Cores, it is optimized for much higher performance on GPUs with Tensor Cores.
+The SDK is supported on NVIDIA GPUs that are based on the NVIDIA® Turing™ or Ampere™ architecture and have Tensor Cores.
 
 * Windows OS supported: 64-bit Windows 10
 * Microsoft Visual Studio: 2017 (MSVC15.0) or later
 * CMake: v3.12 or later
 * NVIDIA Graphics Driver for Windows: 455.57 or later
 
-## NVIDIA Branding Guidelines
-If you integrate an NVIDIA Broadcast Engine SDK within your product, please follow the required branding guidelines that are available [here](
-https://nvidia.frontify.com/d/uAobRitG8H8B)
+## NVIDIA MAXINE Branding Guidelines
+If you integrate an NVIDIA MAXINE SDK within your product, please follow the required branding guidelines that are available [here](https://www.nvidia.com/maxine-sdk-guidelines/)
 
 ## Compiling the sample apps
 
 ### Steps
 
 The open source repository includes the source code to build the sample applications, and a proxy file NVVideoEffectsProxy.cpp to enable compilation without explicitly linking against the SDK DLL.
 
-**Note: To download the models and runtime dependencies required by the features, you need to run the [SDK Installer](https://developer.nvidia.com/rtx-broadcast-engine).**
+**Note: To download the models and runtime dependencies required by the features, you need to run the [SDK Installer](https://www.nvidia.com/broadcast-sdk-resources).**
 
 1.	In the root folder of the downloaded source code, start the CMake GUI and specify the source folder and a build folder for the binary files.
 *	For the source folder, ensure that the path ends in OSS.