Performance testing tool

Former Member
Former Member
Hello everyone, in some of our recent releases, VirbEdit has shipped with a new diagnostic tool. I use it internally for testing our application, but we decided it could be useful or interesting for live use as well. It actually serves a few purposes, but the one that may be of interest to the community is the performance profiling tool. It essentially uses the VirbEdit video processing module to test how fast it can read a video. For those of you who are brave enough to use the Windows command prompt, you can do the following:

change directory to your VirbEdit install directory, usually C:\program Files (x86)\Garmin\VIRB Edit and run this command:
MediaFoundation.Tests.exe --performance <path to any Virb video file>

The application reads the entire video file from start to finish (so using a 15 minute video could take a while) using all decoding technologies available in VirbEdit then reports back the time it took, and the over all frame rate. This will give you a good idea of which decoding technologies work best on your machine. It is also a very good indication of how video playback in VirbEdit will perform. I'd love to see what kinds of performance different machines get. Give the tool a try and post the results here! Be sure to include machine specs and what kind of video you used.
  • Former Member
    0 Former Member over 8 years ago
    I'll start:

    OS: Windows 7 64 bit
    CPU: Intel Core I7-2600
    Video card: Nvidia GTX 650
    RAM: 16 GB

    Target Video: VIRB0015-2.MP4 720x1280 @ 240 FPS

    Tool Output:
    Running Media Foundation performance test...
    Finished reading VIRB0015-2.MP4 in 54.9489229939936 seconds. (311.98063703403 FPS)

    Running Ffmpeg performance test...
    Finished reading VIRB0015-2.MP4 in 30.879213038017 seconds.(555.163111796092 FPS)

    Running Ffmpeg with DXVA performance test...
    Finished reading VIRB0015-2.MP4 in 42.0833924719773 seconds.(407.35784339191 FPS)

    Tests completed in 00:02:08.3148302

    Pro Tip: Redirect the output to a text file so you can copy and paste it more easily:
    MediaFoundation.Tests.exe --performance C:\VIRB0015-2.MP4 > C:\performanceTest.txt
  • Former Member
    0 Former Member over 8 years ago
    Will test tonight

    I will try and get this tested tonight when if I get time or sometime this weekend.

    I have noticed something interesting though, that the Ffmpeg is nearly twice as quick as MF, so using the CPU is faster than the GPU to read a video.. Yet on the sticky thread about encoders and decoders, it is noted that the decoder is for reading the videos and the GPU using MF is faster as per other test results known. So yeah very strange.

    Also we should probably note if we are performing the test from an SSD or HDD and should probably be using the same video file. Maybe we should have a video file we can all download and perform the test on? ie share via dropbox or google drive?
  • Former Member
    0 Former Member over 8 years ago
    On an *ahem* Older System

    OS: Win7 64-bit
    CPU: AMD K6-2 5200+ (2.6GHz)
    RAM: 4 GB
    Video: NVIDIA GeForce GT 730 4GB

    Target video: xx.mp4 1920x1080 @ 60 FPS (3 mins)

    Tool Output:
    Running Media Foundation performance test...
    Finished reading VIRB_0016.mp4 in 219.23115016seconds. (49.440966724343 FPS)

    Running Ffmpeg performance test...
    Finished reading VIRB_0016.mp4 in 181.0442632seconds.(59.8693369699659 FPS)

    Running Ffmpeg with DXVA performance test...
    Finished reading VIRB_0016.mp4 in 58.2891726seconds.(185.952202038977 FPS)

    Tests completed in 00:07:39.4424000
  • OS: Win10 64-bit
    CPU: Intel I7 3537(2.00 GHZ)
    RAM: 8 GB
    Video: Intel HD Graphics 4400
    HDD: mSATA SSD

    Target video: 1920x1080 @ 30 FPS (25 Sec)

    Tool Output:
    Running Media Foundation performance test...
    in 21,7731448019986seconds. (35,5943069798931 FPS)

    Running Ffmpeg performance test...
    in 18,6447090180009seconds.(41,6203867408602 FPS)

    Running Ffmpeg with DXVA performance test...
    in 1,16802490800183seconds.(664,369393737952 FPS)

    Tests completed in 00:00:42.0059962

    It seems that DXVA is working a "bit" faster on dedicated graphics :rolleyes:
    Due to the fact, it´s my private Tablet (Convertible) which was not supposed to play games or something, I´ll redo a test on my working PC with a real graphic card. That should prove the difference :)
  • Former Member
    0 Former Member over 8 years ago
    Test results

    OS: Win10 64-bit
    CPU: Intel I7 3770K @4.1GHZ
    RAM: 16 GB
    Video: Nvidia GTX 970 (Slightly Overclocked)
    SSD Raid Array


    Target video: 1920x1080 @ 60 FPS (53 Sec)

    Running Media Foundation performance test...
    Finished reading testvideo.mp4 in 18.2356816580002seconds. (174.164040564212 FPS)

    Running Ffmpeg performance test...
    Finished reading testvideo.mp4 in 9.79421313700004seconds.(324.273114702995 FPS)

    Running Ffmpeg with DXVA performance test...
    Finished reading testvideo.mp4 in 7.22915111800012seconds.(439.332357030408 FPS)

    Tests completed in 00:00:35.5333383
  • Former Member
    0 Former Member over 8 years ago
    OS: Win10 64-bit Anniversary Update (running on Microsoft Surface 4)
    CPU: Intel I7 6650U @ 2.2GHZ
    RAM: 8 GB
    Video: Intel Iris Graphics 540
    Source Video: 1080p @ 60fps 5min 53sec

    Running Media Foundation performance test...
    Finished reading test.mp4 in 20.4940542689874seconds. (517.515951738721 FPS)

    Running Ffmpeg performance test...[h264 @ 07254CE0] Increasing reorder buffer to 1
    Finished reading test.mp4 in 104.659662850027seconds.(101.328436488436 FPS)

    Running Ffmpeg with DXVA performance test...[h264 @ 061C2920] Increasing reorder buffer to 1
    Finished reading test.mp4 in 19.1779118690174seconds.(552.979911078471 FPS)

    Tests completed in 00:02:24.6060508
  • OS: Windows 10 Enterprise x64
    CPU Type
    Intel(R) Core(TM)2 Quad CPU Q9550 @ 2.83GHz
    RAM: 8GB 1600
    Video: Graphics Chipset
    AMD Radeon R9 200 Series
    Source Video 180p 60fps 15:00 minutes
    Samsung SSD 120gb

    C:\Program Files (x86)\Garmin\VIRB Edit>MediaFoundation.Tests.exe --performance H:\VirbImport\virb_0012.mp4

    Running Media Foundation performance test...
    Finished reading virb_0012.mp4 in 548.612952092008seconds. (98.3407332879591 FPS)

    Running Ffmpeg performance test...
    Finished reading virb_0012.mp4 in 420.943192229999seconds.(128.166937952335 FPS)

    Running Ffmpeg with DXVA performance test...
    Finished reading virb_0012.mp4 in 537.110366798996seconds.(100.446767247355 FPS)



    EDIT:
    Are one of these options supposed to be using any/much of my GPU Activity? I was monitoring GPU % Active in AMD Overdrive and it never went above 5% which could have been from me watching Youtube while this test was working. I use Wondershare Filmora for various video editing and it also does not use my video card at all for any of the conversions. Wondershare support says it's a bug that they plan to fix in their software with AMD/Radeon Video cards
    Tests completed in 00:25:07.6686311
  • Former Member
    0 Former Member over 8 years ago
    OS: Windows 10 Pro
    CPU: AMD Phenom Quad 2.30GHz
    Video cards: 2 x Nvidia GeForce GTX 460
    RAM: 8GB

    Video: mp4, 1280x720, 60fps, 1m 25s.

    Output:

    Running Media Foundation performance test...
    Finished reading AutoX_2016.08.21_Run4.mp4 in 102.264011107967seconds. (50.0664891248443 FPS)
    Running Ffmpeg performance test...
    Finished reading AutoX_2016.08.21_Run4.mp4 in 21.2804021099582seconds.(240.643948997731 FPS)
    Running Ffmpeg with DXVA performance test...No free DXVA2 surface!
    [h264 @ 09C65580] get_buffer() failed
    [h264 @ 09C65580] thread_get_buffer() failed
    [h264 @ 09C65580] decode_slice_header error
    [h264 @ 09C65580] no frame!
    No free DXVA2 surface!
    [h264 @ 09C65580] get_buffer() failed
    [h264 @ 09C65580] thread_get_buffer() failed
    [h264 @ 09C65580] decode_slice_header error
    [h264 @ 09C65580] no frame!
    No free DXVA2 surface!
    [h264 @ 09C65580] get_buffer() failed
    [h264 @ 09C65580] thread_get_buffer() failed
    [h264 @ 09C65580] decode_slice_header error
    [h264 @ 09C65580] no frame!

    Oooops. Eventually finishing with:

    Finished reading AutoX_2016.08.21_Run4.mp4 in 44.5574283379829seconds.(84.4976952314489 FPS)
    Tests completed in 00:02:50.9204561

    Cheers.