All document management servers claim CMIS compatibility. But how compatible are they really?
Rank | Product | Version | Score (*) | CMIS version | Capabilities | URL | Workbench version | OK | Skipped | Warning | Failure | Exception | Details | Test date |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
#1 | NemakiWare | Live demo | 288 | CMIS 1.1 | 8 | [↗] | 0.12.0 | 36 | 4 | 3 | 0 | 0 | Full report | 2014-11-17 |
#2 | OpenText Documentum | 7.3.0 | 243 | CMIS 1.1 | 9 | [↗] | 1.0.0 | 31 | 7 | 19847 | 4381 | 4 | Full report | 2016-09-15 |
#3 | Nuxeo | 5.9.4 | 240 | CMIS 1.1 | 10 | [↗] | 0.11.0 | 34 | 11 | 139 | 695 | 10 | Full report | 2014-07-18 |
#4 | Alfresco | Community 5.0.a | 232 | CMIS 1.0 | 8 | [↗] | 0.11.0 | 29 | 10 | 65 | 25 | 0 | Full report | 2014-07-18 |
#5 | IBM FileNet P8 Content Manager | 5.2.0.2 | 220 | CMIS 1.0 | 10 | [↗] | 0.11.0 | 24 | 7 | 4000 | 28 | 2 | Full report | 2014-07-18 |
#6 | eXo Platform | Live demo | 182 | CMIS 1.0 | 7 | [↗] | 0.11.0 | 30 | 15 | 656 | 4893 | 4 | Full report | 2014-07-18 |
#7 | Microsoft Office SharePoint Server | 2013 15.0.0.0 | 98 | CMIS 1.0 | 7 | [↗] | 0.12.0 | 30 | 13 | 114 | 619 | 16 | Full report | 2015-01-15 |
(*) Higher score is better. Score is calculated as the sum of the number of OKs, minus the number of unexpected exceptions, multiplied by the number of capabilities. The score formula needs to be made smarter, ideas and implementations are welcome.
Test procedure
- Download the latest Apache Chemistry CMIS Workbench
- Run CMIS Workbench and log into your ECM server (AtomPub). If given a choice, choose the repository that typically contains most project documents
- Press the TCK button, let every option at their default value, and press run
- The tests will run for a few minutes, and at the end a results dialog will show up
- Select HTML, a browser window will open showing the details
- Press CTRL-S to save the HTML
- Send the HTML file to our email address or send a pull request to our Github. Don't forget to send us the server version, the version of CMIS Workbench, and the CMIS URL address used.
Contribute your results
We don't have access to all ECM products. Please send us credentials to your test servers after making sure they do not contain confidential data. You may also want to test your servers by yourself, the test procedure is detailed in the paragraph above. Thanks!
This page is a collaborative effort, hosted on Github. Don't hesitate to join us and send us pull requests. Our goal is to improve ECM interoperability by forcing all ECM vendors to make sure their CMIS implementation is correct. Like Acid did for HTML/CSS.
Alternate versions
For each product, in the ranking we only keep the most recent release. If there are several editions, or several CMIS URLs, we only keep the best score.
Product | Version | Score | CMIS version | Capabilities | URL | Workbench version | OK | Skipped | Warning | Failure | Exception | Details | Test date |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Alfresco | Community 5.0.a | 224 | CMIS 1.1 | 8 | [↗] | 0.11.0 | 30 | 7 | 85 | 132 | 2 | Full report | 2014-07-18 |
IBM FileNet P8 Content Manager | 5.1.0 | -165 | CMIS 1.1 | 11 | [↗] | 0.11.0 | 32 | 5 | 3313 | 663 | 47 | Full report | 2015-01-22 |
IBM FileNet P8 Content Manager | 5.1.1 | 308 | CMIS 1.0 | 11 | [↗] | 0.11.0 | 29 | 6 | 3428 | 0 | 1 | Full report | 2014-07-18 |
OpenText Documentum | 6.7.1 | 171 | CMIS 1.0 | 9 | [↗] | 0.9.0 | 28 | 6 | 25398 | 1109 | 9 | Full report | 2013-08-15 |
IBM FileNet P8 Content Manager | 5.2.0.1 | -198 | CMIS 1.0 | 11 | [↗] | 0.11.0 | 28 | 6 | 4086 | 1 | 46 | Full report | 2014-07-18 |