Understanding how various quantum computers are performing can be a quite complex task. Not only are there a multitude of different quantum benchmark suites that are proliferating, but it is not always easy to find the results of the tests and compare them against each other. Fortunately, the Unitary Fund has just created service called Metriq that allows users to post in a common place the results of their tests of many different benchmark tests. A user will submit an entry into the Metriq data base that includes the test conditions, results, and references to any technical papers that describes the activity in more detail. Metriq can then make it available for viewing and can show the results organized by Tasks, Methods, Platforms, or Tags to allow viewers to compare or download a spreadsheet that shows the various results. The data base has over 150 submissions as of this writing and by creating a open community that can contribute to the data base on a daily basis it will certainly make the task of understanding how the various platforms are performing much more transparent. Additional information about Metriq is available in a press release posted on the Unitary Fund website here, an introduction video on YouTube here, and a tutorial video on YouTube explaining how to make a submission here.
May 17, 2022