{"id":21628,"date":"2025-02-03T08:12:13","date_gmt":"2025-02-03T07:12:13","guid":{"rendered":"https:\/\/www.atriga.com\/?p=21628"},"modified":"2025-10-10T11:22:24","modified_gmt":"2025-10-10T09:22:24","slug":"eu-ai-act-meets-genai-bots-what-the-financial-sector-needs-to-consider-now","status":"publish","type":"post","link":"https:\/\/www.atriga.com\/en\/company\/atriga-up-to-date\/news\/eu-ai-act-meets-genai-bots-what-the-financial-sector-needs-to-consider-now\/","title":{"rendered":"EU AI Act meets GenAI bots: what the financial sector needs to consider now"},"content":{"rendered":"
[vc_row full_width=”stretch_row” remove_bottom_col_margin=”true” bg_type=”bg_color” bg_color_value=”#e9eef4″ el_class=”header-pic”][vc_column css=”.vc_custom_1573046173484{background-image: url(\/wp-content\/uploads\/2019\/09\/header-grafik-atriga-news.jpg?id=6602) !important;background-position: 0 0 !important;background-repeat: no-repeat !important;}” min_height=”200px”]atriga News<\/span><\/span>[\/vc_column][\/vc_row][vc_row remove_bottom_col_margin=”true”][vc_column width=”2\/3″ css=”.vc_custom_1566994559772{background-position: 0 0 !important;background-repeat: no-repeat !important;}”][vc_row_inner][vc_column_inner]

EU AI Act meets GenAI bots: what the financial sector needs to consider now<\/span><\/h1>[vc_empty_space][vc_column_text css=””]On 21 May 2024, the EU member states adopted the EU AI Act – the first comprehensive regulation worldwide to lay down rules for the use of artificial intelligence.<\/strong><\/p>\n

The legal framework is intended to provide security for consumers and companies in Europe by creating clear standards for the use of AI technologies. The regulation addresses potential risks such as data breaches, discrimination and security vulnerabilities. To ensure adequate protection, AI systems are categorised into different risk classes, with stricter requirements applying to technologies with a higher risk potential.<\/strong><\/p>\n

The first bans on certain AI applications will now take effect from February 2025, while most of the regulations will not apply until August 2026.<\/strong><\/p>\n

We spoke to atriga Data Protection Officer Kristin Pagnia about the EU AI Act and what it means for the use of AI systems in the financial sector.
\n<\/strong><\/p>\n

The second part of our interview series on the EU AI Act can be found here<\/a>.<\/strong><\/p>\n

 <\/p>\n

Mrs Pagnia, what is behind the EU AI Act and what are the specific aims of the regulation?<\/h4>\n

The EU AI Act is the first comprehensive regulation to create clear rules and a framework for the use of artificial intelligence (AI) in Europe. The EU aims to promote innovation while at the same time addressing the risks of AI and ensuring that people’s fundamental rights are protected. Companies will be enabled to use pioneering technologies. At the same time, the possibility of crossing borders with AI is restricted. This is important because AI could make many things possible that are ethically unacceptable. In companies, this includes, among other things, selection procedures for applicants that could be used excessively with AI. The Al Act sets clear limits to the imagination here. In order to guarantee the protection of fundamental rights, it is important to establish this idea of protection at an early stage of AI development and to set ethical limits to the economic interests of companies.[\/vc_column_text][\/vc_column_inner][\/vc_row_inner][vc_empty_space][vc_column_text css=””]\n

When do you expect the first landmark judgements and what could they mean for practice?<\/h4>\n

The AI Act has been in force since August 2024, but most of the provisions of the AI Regulation will only apply from 1 August 2026, so it will be years before the first judgements on the AI Regulation are legally binding. In this respect, companies will have to live with some uncertainties for a while yet. Nevertheless, it makes sense to get to grips with the new regulations now and tackle their implementation.[\/vc_column_text][vc_empty_space][vc_column_text css=””]\n

Kristin Pagnia, lawyer and internal data protection officer at atriga: \u201cCompanies that use AI or are planning to use it should already be familiarising themselves with the provisions of the AI Regulation and starting to implement them.\u201d<\/strong><\/em><\/p><\/blockquote>\n[\/vc_column_text][vc_empty_space][vc_single_image image=”12608″ css=””][vc_empty_space height=”12px”][vc_empty_space][vc_column_text css=””]\n

What impact do the risk classes have on the use and further development of AI? And what exactly does it mean when an application is categorised as \u201chigh risk\u201d?<\/h4>\n

The AI Act divides AI systems into different risk classes, using a risk-based approach:The higher the risk, the stricter the obligations. The AI Act distinguishes four risk levels for AI applications as well as a group for AI models with a general purpose. According to Article 49 of the AI Act, high-risk AI systems must be registered in the EU database for high-risk AI systems. The requirements for ‘high-risk’ AI systems are significantly higher than for lower-risk systems. Providers and operators of AI systems should therefore carefully weigh up the level of risk they wish to work with when using and further developing AI.[\/vc_column_text][vc_empty_space][vc_column_text css=””]\n

What do companies need to consider regarding the transparency of GenAI chatbots or voicebots? What steps should companies take from a data protection perspective to ensure that GenAI bots meet these requirements?<\/h4>\n

The regulation requires special transparency for AI applications that interact with humans. The AI Regulation classifies AI systems that interact with humans as AI systems with limited risk. Chatbots belong to this group. For the legally safer use of chatbots, the EU requires that chatbots that work with AI must be transparent. This means that users must be informed that they are chatting or talking to an AI. In addition to information about the interaction with an AI, the user should also be able to understand the decisions made by the AI. This should enable users to make a decision for or against the further use of AI at any time.[\/vc_column_text][vc_empty_space][vc_column_text css=””]\n

The regulation threatens high penalties for non-compliance. How are companies preparing for this?<\/h4>\n

The EU is working with a three-tier sanctions concept in which the possible sanctions even go beyond the possible fines under the General Data Protection Regulation (GDPR). The year 2026 is coming faster than anyone thinks possible. In this respect, companies that use AI or are planning to use it should already be dealing with the provisions of the AI Regulation and start implementing them now. This also includes a well-developed compliance concept.[\/vc_column_text][vc_empty_space][vc_column_text css=””]\n

What are the specific challenges for GenAI bots in the financial sector?<\/h4>\n

In the financial sector, dialogs with bots often contain particularly sensitive and sensitive data. Therefore, correspondingly high security measures must be taken to protect them and – as always when implementing data protection – care must be taken to comply with the principles of data protection. Employees involved in the operation and use of AI systems must also be well trained in AI skills. Great opportunities for change are seen in the financial sector as a result of GenAI. It remains important to handle AI responsibly and to earn the trust of users.[\/vc_column_text][vc_empty_space][vc_row_inner][vc_column_inner][vc_column_text css=”.vc_custom_1758890230451{border-top-width: 2px !important;border-right-width: 2px !important;border-bottom-width: 2px !important;border-left-width: 2px !important;padding-top: 15px !important;padding-right: 20px !important;padding-bottom: 15px !important;padding-left: 20px !important;background-color: #f7f7f7 !important;border-left-style: solid !important;border-right-style: solid !important;border-top-style: solid !important;border-bottom-style: solid !important;border-radius: 2px !important;border-color: #a71f1f !important;}”]About the interviewer
\n<\/small><\/strong>Kristin Pagnia has been with atriga GmbH since the company was founded in 2003 and works there as a lawyer, Assistant Head of Legal Services and Data Protection Officer. Kristin Pagnia studied law at the Johann-Wolfgang-Goethe University in Frankfurt and has been working intensively in the field of data protection for many years. She is a member of the data protection working groups of the BDIU and the GDD. Ms. Pagnia has also been a \u201cCompany Data Protection Officer IHK\u201d since 2019.<\/small>[\/vc_column_text][\/vc_column_inner][\/vc_row_inner][vc_empty_space][vc_empty_space][vc_row_inner][vc_column_inner][vc_raw_html css=””]JTNDZGl2JTIwY2xhc3MlM0QlMjJ2Y2V4LW1vZHVsZSUyMHZjZXgtbGlzdF9pdGVtJTIwY2xyJTIyJTNFJTNDYSUyMGhyZWYlM0QlMjIlMkZlbiUyRmNvbXBhbnklMkZhdHJpZ2EtdXAtdG8tZGF0ZSUyRm5ld3MlMkYlMjIlMjB0aXRsZSUzRCUyMlNob3clMjBhbGwlMjBuZXdzJTIyJTIwJTNFJTNDZGl2JTIwY2xhc3MlM0QlMjJ2Y2V4LWljb24td3JhcCUyMiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMnRpY29uJTIwdGljb24tYW5nbGUtZG91YmxlLXJpZ2h0JTIyJTNFJTNDJTJGc3BhbiUzRSUzQyUyRmRpdiUzRSUzQ2RpdiUyMGNsYXNzJTNEJTIydmNleC1jb250ZW50JTIyJTNFU2hvdyUyMGFsbCUyMG5ld3MlM0MlMkZkaXYlM0UlM0MlMkZhJTNFJTNDJTJGZGl2JTNF[\/vc_raw_html][\/vc_column_inner][\/vc_row_inner][\/vc_column][vc_column width=”1\/3″ el_class=”testimonial-pic”][vc_row_inner][vc_column_inner][vc_raw_html]JTNDYSUyMGhyZWYlM0QlMjIlMjMlMjIlM0U=[\/vc_raw_html]

<\/span>

\u201eInnovations optimize your receivables management. Subscribe to the atriga newsletter and be the first to know!\u201c<\/p>\n<\/div><\/div>

\n
\"Lasse<\/div>
\n
Lasse K\u00fchl<\/div>\n\n
\n\n\t\n\t\tHead of Customer Care\n\t\n<\/div><\/div><\/div><\/div><\/div><\/div>[vc_raw_html]JTNDJTJGYSUzRQ==[\/vc_raw_html][\/vc_column_inner][\/vc_row_inner]