Trustworthy AI Research at Karlstad University

This summer, the Privacy and Security Research Group (PriSec) at Karlstad University (KAU) will launch two major projects related to responsible use and trustworthy AI. One of the projects is called OPEHRA ("OPErationalising Human Rights in the Design of AI-supported Digital Health"), based on a Swedish consortium of business and public sector partners together with KAU researchers and funded by the Swedish Knowledge Foundation (KK-Stiftelsen). The second is an EU project named TRUMAN ("TRUstworthy huMAN-centric artificial intelligence"), which includes several universities and industry partners, funded by the EU Horizon Programme.

OPEHRA aims to tackle the problem of operationalizing “human rights by design” and developing new AI systems in the health and social care domains. This project relies on a strong partnership between the Centre for Gender Studies and the Computer Science Department at KAU. Together with our collaborators, which include Mavatar, inTechrity, Pfizer, and SKR, we will work towards co-developing and evaluating fundamental rights impact assessment methods in focused case studies and co-producing materials to bridge the existing AI literacy in the Swedish industry. The project goals are well-aligned with the EU AI Act and the increased demand for legal compliance and due diligence in developing and deploying AI systems.

The goal of TRUMAN is to design and develop generic technologies and methodologies for improving AI systems’ resilience against security, privacy, and fairness attacks, as well as to increase the trust that their users have in these systems while accounting for different phases of the AI life cycle, starting from data collection through training and deployment. The project will also consider the impact of these solutions on humans, how to explain to them the underlying technologies and the risks, and employ their help in improving these models. These technologies will be evaluated against four use cases illustrating scenarios from different sectors, i.e., marketing, IT, finance, and healthcare. Moreover, the TRUMAN project will strive to generate generic/holistic guidelines and recommendations for building trustworthy and robust AI systems.

Keep tuned for further updates related to the OPEHRA project!