Research Associate in Multimodal Machine Learning

Imperial College London

United Kingdom


Job Summary

We are seeking to hire a Research Associate to contribute towards multimodal machine learning, in particular to:

  • Cross-lingual video captioning
  • Applications to language tasks, with emphasis on machine translation, but also automatic speech recognition, text summarisation etc

This position is funded by:

  • the British Council MMVC (A Multimodal and Multilingual Framework for Video Captioning) project.
  • the ERC MultiMT project ( Multimodal Context Modelling for Machine Translation.

Both projects are led by Professor Lucia Specia ( at Imperial College London.

Imperial College is consistently in the top 10 world university ranking. The College achieved second place in the Complete University Guide’s Computer Science subject table for 2017. The Department of Computing has repeatedly been awarded the highest research ratings in the REF assessments, was ranked 1st in the Research Intensity table published by The Times Higher, and was rated as "Excellent" in the most recent national assessment of teaching quality.

Duties and Responsibilities

MMVC is a highly interdisciplinary project involving natural language processing, computer vision and machine learning. Its goal is to devise methods and algorithms to exploit transfer learning approaches to multimodal multilingual video captioning.

MultiMT is a highly interdisciplinary project involving natural language processing, speech processing, computer vision and machine learning. Its goal is to devise methods and algorithms to exploit global multimodal information for context modelling in machine translation and other applications. This will require new ways to acquire multilingual multimodal representations, and new machine learning and inference algorithms that can learn from these rich context models to generate language.

Essential Requirements

A strong track record in at least one of the following areas is essential for this post: machine learning, natural language processing or computer vision. Preference will be given to applicants with experience in multimodal work involving two of more of these areas.

In particular, the following skills are required:

  • Experience in the modelling of natural language processing/computer vision or multimodal tasks using machine learning
  • Experience with deep learning algorithms and deep learning frameworks (e.g. PyTorch, TensorFlow)
  • Significant experience with coding

As Research Associate you must have a PhD (or equivalent) in an area pertinent to the subject areas above. Preference will be given to applicants with proven research record and publications in A-ranked venues. You will need to have excellent written and verbal communication skills and be able to organise your work with minimal supervision and prioritise work to meet deadlines.

Further Information

For further information email and research related enquiries Prof Lucia Specia at

*Candidates who have not yet been officially awarded their PhD will be appointed as Research Assistant within the salary range £34,397 - £37,486 per annum.

In addition to completing the online application form please include the following:

  • A full CV
  • A 1 page statement indicating what you see are interesting research issues relating to the above post and why your expertise is relevant.
  • Additionally please include any material from your past work that you would like us to consider such as significant papers or thesis.

For applications queries please contact Jamie Perrins at


In your application, please refer to


amsterdam uni

antwerp uni

cambridge uni

florida uni

hamburg uni

harvard uni

hiroshima uni

oslo uni

purdue uni

ryerson uni

shanghai jiao tong uni

stockholm uni