Filter Search for grants
Call Navigation
Call key data
Assessment methodologies for General Purpose AI capabilities and risks (AI/Data/Robotics Partnership)
Funding Program
Horizon Europe: Cluster 4 - Digital, Industry and Space
Call number
HORIZON-CL4-2025-04-DIGITAL-EMERGING-04
deadlines
Opening
10.06.2025
Deadline
02.10.2025 17:00
Funding rate
100%
Call budget
€ 7,000,000.00
Estimated EU contribution per project
between € 3,000,000.00 and € 4,000,000.00
Link to the call
Link to the submission
Call content
short description
This topic aims to develop robust assessment tools, techniques, and benchmarks specifically designed to rigorously evaluate GPAI models and systems, including multimodal systems.
Call objectives
The rapid advancement of artificial intelligence (AI) has led to the development of increasingly sophisticated general-purpose AI (GPAI) models and systems. These models, such as large language models and multimodal AI systems, demonstrate remarkable capabilities across a wide range of tasks. However, assessing the capabilities of these models remains a significant challenge. Traditional evaluation methods often fail to capture the full spectrum of abilities exhibited by GPAI models and systems. Therefore, there is a pressing need for the development of new assessment frameworks, methodologies and tools that can comprehensively evaluate these models in terms of their trustworthy and ethical behaviour and operation, ensuring their reliability, fairness, and alignment with human values.
Proposals should cover one or more of the following research areas:
- Innovative methods for proactively identifying and forecasting emergent capabilities in GPAI models and systems. This encompasses the identification of capabilities with both beneficial and potentially detrimental uses.
- Assessment of GPAI capabilities with a significant economic impact or potential for misuse. This includes assessing capabilities that drive beneficial innovation and societal good, as well as evaluating potential risks in areas such as chemical, biological, radiological, and nuclear (CBRN) hazards or cybersecurity threats.
- Developing assessment techniques that illuminate the underlying mechanisms of emergent capabilities in AI systems, emphasising interpretability and explainability.
Projects should generate example benchmark tests to examine trained AI models, systematically uncovering latent capabilities. These benchmarks will be made available to GPAI providers, policymakers, and other relevant stakeholders to implement robust evaluation tools.
This topic strongly encourages the formation of interdisciplinary teams combining the necessary technical expertise. Such a collaborative approach will ensure that assessments accurately capture real-world use cases, including capabilities elicitation techniques, and that the developed frameworks, methodologies and tools are responsive to the concerns of all relevant stakeholders.
read more
Expected effects and impacts
This topic requires the effective contribution of SSH disciplines and the involvement of SSH experts, institutions as well as the inclusion of relevant SSH expertise, in order to produce meaningful and significant effects enhancing the societal impact of the related research activities.
Proposals must adhere to Horizon Europe's requirements regarding Open Science. Open access to research outputs should be provided unless there is a legitimate reason or constraint; in such cases, the proposal should detail how GPAI providers, policymakers, and other stakeholders will access the research outcomes.
All proposals are expected to incorporate mechanisms for assessing and demonstrating progress, including qualitative and quantitative KPIs, benchmarking, and progress monitoring. This should include participation in international evaluation contests and the presentation of illustrative application use-cases that demonstrate concrete potential added value. Communicable results should be shared with the European R&D community through the AI-on-demand platform, and if necessary, other relevant digital resource platforms to bolster the European AI, Data, and Robotics ecosystem by disseminating results and best practices.
This topic implements the co-programmed European Partnership on AI, data and robotics (ADRA), and all proposals are expected to allocate tasks for cohesion activities with ADRA and the CSA HORIZON-CL4-2025-03-HUMAN-18: GenAI4EU central Hub.
Proposals should also build on or seek collaboration with existing projects and develop synergies with other relevant International, European, national or regional initiatives. Regarding European programmes, projects are expected to develop synergies and complementarities with relevant projects funded under Horizon Europe but also under the Digital Europe Programme (DEP).
read more
Expected results
Project results are expected to contribute to some of the following expected outcomes:
- New assessment and validations methodologies developed allowing to evaluate General Purpose AI (GPAI) models, including multimodal systems, and systems’ capabilities and risks.
- Use of the research outcomes by GPAI providers, policymakers, public institutions, and other relevant stakeholders to evaluate GPAI models and systems’ capabilities and risks.
- Support to the AI Office in its function to conduct evaluations of general purpose AI models with a view to enforce the AI Act' rules for general purpose AI models and facilitate self-evaluation for GPAI model developers to ensure compliance with AI Act requirements.
Eligibility Criteria
Regions / countries for funding
Canada, Iceland (Ísland), Israel (ישראל / إِسْرَائِيل), New Zealand (Aotearoa), Norway (Norge), Switzerland (Schweiz/Suisse/Svizzera), United Kingdom
eligible entities
EU Body, Education and training institution, Non-Profit Organisation (NPO) / Non-Governmental Organisation (NGO), Other, Private institution, incl. private company (private for profit), Public Body (national, regional and local; incl. EGTCs), Research Institution incl. University, Small and medium-sized enterprise (SME)
Mandatory partnership
Yes
Project Partnership
To be eligible for funding, applicants must be established in one of the following countries:
- the Member States of the European Union, including their outermost regions
- the Overseas Countries and Territories (OCTs) linked to the Member States
- countries associated to Horizon Europe - see list of particpating countries
Only legal entities forming a consortium are eligible to participate in actions provided that the consortium includes, as beneficiaries, three legal entities independent from each other and each established in a different country as follows:
- at least one independent legal entity established in a Member State; and
- at least two other independent legal entities, each established in different Member States or Associated Countries.
Any legal entity, regardless of its place of establishment, including legal entities from non-associated third countries or international organisations (including international European research organisations) is eligible to participate (whether it is eligible for funding or not), provided that the conditions laid down in the Horizon Europe Regulation have been met, along with any other conditions laid down in the specific call topic.
A ‘legal entity’ means any natural or legal person created and recognised as such under national law, EU law or international law, which has legal personality and which may, acting in its own name, exercise rights and be subject to obligations, or an entity without legal personality.
Specific cases:
- Affiliated entities (i.e. entities with a legal or capital link to a beneficiary which participate in the action with similar rights and obligations to the beneficiaries, but which do not sign the grant agreement and therefore do not become beneficiaries themselves) are allowed, if they are eligible for participation and funding.
- Associated partners (i.e. entities which participate in the action without signing the grant agreement, and without the right to charge costs or claim contributions) are allowed, subject to any conditions regarding associated partners set out in the specific call conditions.
- Entities which do not have legal personality under their national law may exceptionally participate, provided that their representatives have the capacity to undertake legal obligations on their behalf, and offer guarantees to protect the EU’s financial interests equivalent to those offered by legal persons.
- Legal entities created under EU law (EU bodies) including decentralised agencies may be part of the consortium, unless provided for otherwise in their basic act.
- International European research organisations are eligible to receive funding. International organisations with headquarters in a Member State or Associated Country are eligible to receive funding for ‘Training and mobility’ actions or when provided for in the specific call/topic conditions. Other international organisations are not eligible to receive funding, unless provided for in the specific call/topic conditions, or if their participation is considered essential for implementing the action by the granting authority.
- Joint Research Centre (JRC)— Where provided for in the specific call conditions, applicants may include in their proposals the possible contribution of the JRC but the JRC will not participate in the preparation and submission of the proposal. Applicants will indicate the contribution that the JRC could bring to the project based on the scope of the topic text. After the evaluation process, the JRC and the consortium selected for funding may come to an agreement on the specific terms of the participation of the JRC. If an agreement is found, the JRC may accede to the grant agreement as beneficiary requesting zero funding or participate as an associated partner, and would accede to the consortium as a member.
- Associations and interest groupings — Entities composed of members (e.g. European research infrastructure consortia (ERICs)) may participate as ‘sole beneficiaries’ or ‘beneficiaries without legal personality’. However, if the action is in practice implemented by the individual members, those members should also participate (either as beneficiaries or as affiliated entities, otherwise their costs will NOT be eligible.
- EU restrictive measures — Entities subject to EU restrictive measures under Article 29 of the Treaty on the European Union (TEU) and Article 215 of the Treaty on the Functioning of the EU (TFEU) as well as Article 75 TFEU, are not eligible to participate in any capacity, including as beneficiaries, affiliated entities, associated partners, third parties giving in-kind contributions, subcontractors or recipients of financial support to third parties (if any).
- Legal entities established in Russia, Belarus, or in non-government controlled territories of Ukraine — Given the illegal invasion of Ukraine by Russia and the involvement of Belarus, there is currently no appropriate context allowing the implementation of the actions foreseen in this programme with legal entities established in Russia, Belarus, or in non-government controlled territories of Ukraine. Therefore, even where such entities are not subject to EU restrictive measures, such legal entities are not eligible to participate in any capacity. This includes participation as beneficiaries, affiliated entities, associated partners, third parties giving in-kind contributions, subcontractors or recipients of financial support to third parties (if any). Exceptions may be granted on a case-by-case basis for justified reasons.
With specific regard to measures addressed to Russia, following the adoption of the Council Regulation (EU) 2024/1745 of 24 June 2024 (amending Council Regulation (EU) No 833/2014 of 31 July 2014) concerning restrictive measures in view of Russia’s actions destabilising the situation in Ukraine, legal entities established outside Russia but whose proprietary rights are directly or indirectly owned for more than 50% by a legal person, entity or body established in Russia are also not eligible to participate in any capacity. - Measures for the protection of the Union budget against breaches of the principles of the rule of law in Hungary — Following the Council Implementing Decision (EU) 2022/2506, as of 16 December 2022, no legal commitments can be entered into with Hungarian public interest trusts established under the Hungarian Act IX of 2021 or any entity they maintain. Affected entities may continue to apply to calls for proposals and can participate without receiving EU funding, as associated partners, if allowed by the call conditions. However, as long as the Council measures are not lifted, such entities are not eligible to participate in any funded role (beneficiaries, affiliated entities, subcontractors, recipients of financial support to third parties, etc.).In case of multi-beneficiary grant calls, applicants will be invited to remove or replace that entity in any funded role and/or to change its status into associated partner. Tasks and budget may be redistributed accordingly.
other eligibility criteria
In order to achieve the expected outcomes, and safeguard the Union’s strategic assets, interests, autonomy, and security, it is important to avoid a situation of technological dependency on a non-EU source, in a global context that requires the EU to take action to build on its strengths, and to carefully assess and address any strategic weaknesses, vulnerabilities and high-risk dependencies which put at risk the attainment of its ambitions. For this reason, participation is limited to legal entities established in Member States, Iceland and Norway and the following additional associated countries: Canada, Israel, the Republic of Korea, New Zealand, Switzerland, and the United Kingdom.
For the duly justified and exceptional reasons listed in the paragraph above, in order to guarantee the protection of the strategic interests of the Union and its Member States, entities established in an eligible country listed above, but which are directly or indirectly controlled by a non-eligible country or by a non-eligible country entity, may not participate in the action unless it can be demonstrated, by means of guarantees positively assessed by their eligible country of establishment, that their participation to the action would not negatively impact the Union’s strategic assets, interests, autonomy, or security. Entities assessed as high-risk suppliers of mobile network communication equipment within the meaning of ‘restrictions for the protection of European communication networks’ (or entities fully or partially owned or controlled by a high-risk supplier) cannot submit guarantees.
Additional information
Topics
Relevance for EU Macro-Region
EUSAIR - EU Strategy for the Adriatic and Ionian Region, EUSALP - EU Strategy for the Alpine Space, EUSBSR - EU Strategy for the Baltic Sea Region, EUSDR - EU Strategy for the Danube Region
UN Sustainable Development Goals (UN-SDGs)
Additional Information
Applications must be submitted electronically via the Funders & Tenders Portal electronic submission system (accessible via the topic page in the Search Funding & Tenders section). Paper submissions are NOT possible.
Applications must be submitted using the forms provided inside the electronic submission system (not the templates available on the topic page, which are only for information). The structure and presentation must correspond to the instructions given in the forms.
Applications must be complete and contain all parts and mandatory annexes and supporting documents.
The application form will have two parts:
- Part A (to be filled in directly online) contains administrative information about the applicant organisations (future coordinator and beneficiaries and affiliated entities), the summarised budget for the proposal and call-specific questions;
- Part B (to be downloaded from the Portal submission system, completed and then assembled and re-uploaded as a PDF in the system) contains the technical description of the project.
Annexes and supporting documents will be directly available in the submission system and must be uploaded as PDF files (or other formats allowed by the system).
The limit for a full application (Part B) is 45 pages.
Activities are expected to start at TRL 2 and achieve TRL 5 by the end of the project.
To see more information about this call, you can register for free here
or log in with an existing account.
Log in
Register now