The STM Integrity Hub, at present, offers two distinct applications: On-Demand Screening (ODS) and Ambient Screening (AS). Each of these applications can be configured to include various tools that perform specific checks in the broad area of research integrity. Each individual publisher using ODS and/or AS (“Hub User”) may configure their specific version of the ODS and AS applications to include the tools that they wish, based on the portfolio of available tools per application that is managed by STM Solutions (“Tool Portfolio”). In general, STM Solutions strives to make available as many quality tools as possible for both the ODS and AS applications within limitations stemming from computational capacity, budget and resources.

For clarity, the Tool Portfolio includes tools developed by STM Solutions (e.g. the duplicate submissions checker); open-source tools deployed on the STM Integrity Hub technical infrastructure (e.g. tortured phrases); tools contributed by STM-member organisations; and (integrations with) commercial tools provided by third parties.

While STM Solutions is continuously looking to expand the Tool Portfolio to increase the value and utility for ODS and AS applications for Hub Users, there are limited resources available to evaluate, integrate, test, and deploy new tools. This means that the inclusion of additional tools into the Tool Portfolio will follow a prioritization process that considers both cost of implementation and value to Hub Users. The ranking of prospective new tools by the value to Hub Users is done at regular intervals, through anonymous voting by the STM Integrity Expert Group, which consists of representatives from Hub Users.

For third-party service providers that wish to be included in the Tool Portfolio, the process is as follows:

• After expressing interest to STM Integrity Hub staff, the service provider will be invited to present their tool at an upcoming STM Integrity Hub Expert Group meeting (which in general meets once per month);
• At regular intervals, but at least two times per year, the STM Integrity Hub Expert Group will prioritize prospective new tools which may include tools from third-party service providers. If a tool from a service provider is selected, it enters the pilot program.
• Under this pilot program, the tool will be tested (in a real-life setting, using actual submitted material) with a limited number of journals and publishers for a period of three months. Participation in the pilot is voluntary for Hub Users. Note that an integration agreement between STM Solutions and vendor will need to be put in place at this stage, based on a standard template.
• After the pilot period, the participating Hub Users will be asked to provide feedback on the value of tool, considering factors such as reliability, clarity of the output, utility in flagging suspicious manuscripts and/or identifying specific issues of concern, and precision & recall. If the feedback shows clear support to continue using the tool, and Hub Users vote in favour of inclusion, it can be added to the Tool Portfolio and made available to all Hub Users, barring possible limitations due to computational capacity, budget, or other resource constraints.
• Note that, in consultation with the STM Integrity Hub Expert Group, tools may also be removed from the Tool Portfolio in case of limited use, negative feedback from Hub User, costs, or other considerations.

For the avoidance of doubt, integration into the STM Integrity Hub does not come with any expectations of exclusivity, and third-party service providers are free at all times to discuss and make arrangements with individual publishers, editorial systems, etc.

For more information and to apply for the pilot program, contact Joris van Rossum.