Info_PILLAR 2 - HORIZON EUROPE

Pillar 2: Global Challenges and European Industrial Competitiveness

The Global Challenges and European Industrial Competiveness pillar supports research relating to societal challenges and reinforces technological and industrial capacities through 6 CLUSTERS.

It sets EU-missions with ambitious goals tackling some of our biggest problems. More information on Missions is available here.

It also includes activities pursued by the Joint Research Centre which supports EU and national policymakers with independent scientific evidence and technical support.

Social sciences and humanities are fully integrated across all clusters, including specific and dedicated activities.

Pillar II covers activities from a broad range of Technology Readiness Levels (TRLs),
including lower TRLs.

Pillar II holds the lion’s share of the HE programme funding.
 
Pillar II supports research projects carried out by international and inter-disciplinary consortia. The projects address specific pre-defined topics proposed by the EC which fall into six different clusters, each of them focused on specific global societal and industrial challenges. More information on the specific content of each cluster is available by clicking the links below:

  1. Health
  2. Culture Creativity and Inclusive Society
  3. Civil Security for Society
  4. Digital Industry & Space
  5. Climate, Energy & Mobility
  6. Food, Bioeconomy, Natural Resources, Agriculture & Environment

Last modification date: 20/09/2024

Horizon Europe: Pillar 2 projects

LUMINOUS: Language Augmentation for Humanverse

Specific programme: HORIZON-CL4-2023-HUMAN-01-21


UPV/EHU Partner Status: Beneficiary
UPV/EHU PI: Oier López de la Calle Lecuona

Project start: 01/01/2024
Project end: 31/12/2026

Brief description:

LUMINOUS aims at the creation of the next generation of Language Augmented XR systems, where natural language-based communication and Multimodal Large Language Models (MLLM) enable adaptation to individual, not predefined user needs and unseen environments. This will enable future XR users to interact fluently with their environment, while having instant access to constantly updated global as well as domain- specific knowledge sources to accomplish novel tasks. We aim to exploit MLLMs injected with domain specific knowledge for describing novel tasks on user demand. These are then communicated through a speech interface and/or a task adaptable avatar (e.g., coach/teacher) in terms of different visual aids and procedural steps for the accomplishment of the task. Language driven specification of the style, facial expressions, and specific attitudes of virtual avatars will facilitate generalisable and situationaware communication in multiple use cases and different sectors. LLMs will benefit in parallel in identifying new objects that were not part of their training data and then describing them in a way that they become visually recognizable. Our results will be prototyped and tested in three pilots, focussing on neurorehabilitation (support of stroke patients with language impairments), immersive industrial safety training, and 3D architectural design review. A consortium of six leading R&D institutes experts in six different disciplines (AI, Augmented Vision, NLP, Computer Graphics, Neurorehabilitation, Ethics) will follow a challenging workplan, aiming to bring about a new era at the crossroads of two of the most promising current technological developments (LLM/AI and XR), made in Europe.

info_masinformacionehurope

Contact information:

International R&D Office UPV/EHU
Email: proyectoseuropeos@ehu.es

Last modification date: 12/09/2024