Technology Enhanced Learning of Musical Instrument Performance

TELMI - Technology Enhanced Learning of Musical Instrument Performance


TELMI is a Research and Innovation action coordinated by MTG-UPF and funded by the European Commission.
TELMI will last 36 months starting the first of February 2016 and the partner institutions involved are: Universitat Pompeu Fabra, University of Genova, Royal College of Music, HIGHSKILLZ, and SAICO INTELLIGENCE, S.L.


Learning musical instruments is challenging. Musicians, whether those at the beginning of their journey or experienced practitioners, must balance the need to learn a great deal of technique and repertoire with limitations in their time, physical and mental endurance, and ability to communicate a complex and abstract set of thoughts and movements. This results in the high rates of stress, frustration, burnout, and injury seen among musicians at all levels, and can deter young musicians from taking up or continuing with their studies.

The TELMI project is addressing these challenges by developing a suite of technology to enhance musical learning. Using the violin as a case study, the Royal College of Music is developing a pedagogical framework for the system that embraces both traditional methods of violin instruction and modern cognitive research on how people gain expertise and learn skills efficiently and effectively. At the heart of the system are the groundbreaking advancements in audio, video, and motion-capture systems being developed by the project partners at Pompeu Fabra University and the University of Genoa. Highskillz is bringing its expertise in digital learning platforms and gamification to develop an intuitive user interface that can both guide and motivate a beginner and provide high-level feedback to an expert, all while incorporating a social learning system that helps musicians learn from their peers. SAICO Intelligence will guide the resulting system to the market, ensuring it reaches as many potential users as possible.

Over three years (2016-19), TELMI will result in a unified system that can be tailored to a wide range of musicians, experience levels, and learning situations. It will help musicians make the most of their time in lessons and practice, reduce injury and inefficiency, expand their access to communities of musical knowledge, and become better performers.

flag_yellow_h60This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688269

The general objectives of the TELMI project are:

1. to design and implement new interaction paradigms for music learning and training based on state-of-the-art multi-modal (audio, image, video, and motion) technologies,

2. to evaluate the pedagogical effectiveness of such new paradigms,

3. to develop new multi-modal, interactive music learning prototypes for student-teacher, student only, and collaborative learning scenarios,

4. to create a publicly available reference database of multimodal recordings for online learning and social interaction among students.

The results of the project will serve as a basis for the development of next generation music learning systems, thereby improving on current student-teacher interaction and student-only practice, providing the potential to make music education and its benefits accessible to a substantially wider public.


Universitat Pompeu Fabra
Università degli Studi di Genova
Royal College of Music
Saico Intelligence SL


The project consortium’s members have published a number of journal publications, and conference and workshop papers on the scientific concerns addressed in TELMI and related directly to enhancing music learning with technology.

A complete list of these publications can be found here.

Public Deliverables

D.1.2 Data Management Plan. download

D.2.5 User-evaluations of each technology in each scenario completed download

D.3.2 First working prototypes of the measuring systems. download

D.3.3 Second Version of the Data Acquisition System Prototypes download

D.6.2 First version of TELMI System Platform download

D.7.2 Start-up public event. download

D.7.3 Website of the Project, 1st version. download

D.7.4 Second public event. download

D.7.5 Final public event. download

Open Database

During the TELMI project a set of multi­modal recordings of performances was captured, including teachers and students. This data was used in the TELMI prototypical solutions for technology-enhanced music learning, as well as to refine analysis algorithms developed during the project. The raw data acquired from performances was analyzed and enriched with feature extraction techniques. This data is now available online in this public database under a Creative Commons (CC) license.

Access the database here.




If you have any enquieries, please do not hesitate contacting us

Music Technology Group
Communication Campus-Poblenou
Universitat Pompeu Fabra
Tanger, 122-144 (3rd floor)
08018 Barcelona
Telf. +34.93.542.2194