Profile picture

Soumya Sai Vanka

Applied AI researcher in intelligent audio systems

London, England • Email meLinkedInGoogle ScholarGitHub

Download PDF

About Me

Applied AI researcher with 4+ years of experience building intelligent audio systems using deep learning and user-centred design. Strong background in ML experimentation, data pipelines, and product-facing research. Experienced in translating research into real-world creative prototypes.

Skills & Tools

Deep learning (Transformers, graph neural networks, generative modelling for audio, contrastive learning, DDSP), data visualisation and analysis, dataset curation and synthetic data generation, mixed-methods user studies (qualitative and quantitative), UX research and user-centred design.

PyTorch, Keras, Scikit-Learn, PyTorch Lightning, W&B, Python (high competence), C++ (basic), Docker, Git, Kubernetes, LaTeX, MAXQDA, NVivo.

Research Experience

Research and Development Intern, Yamaha Corporation

Hamamatsu, Japan · June 2026 – Present
  • Working on mixing workflow personalisation for mixing consoles, as part of the R&D Division project “Analyzing Individuality in the Workflows of Mixing Music.”
  • Researching the structural analysis and modelling of mixing workflows to support more efficient and creative music production.
  • Analysing how engineers apply audio effects and construct sound imagery through effect chains and track selection during mixdown.
  • Applying machine learning to model the individuality and consistency of each engineer’s practice, informing customised, personalised mixing console systems.
  • Collaborators: Yu Takahashi, Hayato Yamakawa, Kazunobu Kondo (MixerAI team).

PhD Researcher, Queen Mary University of London

London, UK · Sept 2021 – Present · Full time
  • Designed, trained and evaluated deep learning models for controllable music mixing style transfer.
  • Built large-scale synthetic audio datasets for training and benchmarking ML systems.
  • Led user-centred ML research with professional mixing engineers to define product requirements and validate usability.
  • Designed interaction workflows for ML-based multitrack mixing systems integrated into DAWs.
  • Conducted large-scale UX studies and listening tests to evaluate model behaviour in real creative workflows.
  • Collaborated with industry partners at Steinberg Media Technologies on future product-facing research.
  • Mentors and collaborators: George Fazekas (QMUL), Jean-Baptiste Rolland (SMTG), Yvan Grabit (SMTG).

Intern, Sony Research

Tokyo, Japan · Jan–April 2025 · Full time
  • Designed ML representations for music mixing effect chains using graph neural networks and contrastive learning.
  • Built data pipelines for large-scale multitrack scraping and synthetic mix generation.
  • Conducted computational research on representation learning for audio post-production workflows.
  • Collaborators: Marco Martinez (Supervisor), Sunghoo Lee (Seoul National University), Junghyun Koo, Wei-Hsiang Liao, Yuki Mitsufuji.

Trainee Intern, Steinberg Media Technologies GmbH

Aug–Dec 2022; Nov 2023–Apr 2024 · Part time
  • Developed deep learning systems for context-aware music mixing using PyTorch on Kubernetes-based infrastructure.
  • Implemented differentiable audio effects and VST plugins for real-time ML-based processing.
  • Led dataset design for multitrack mixing research used across academic and industry projects.
  • Collaborators: Jean-Baptiste Rolland, Lennart Hannink, Yvan Grabit.

Education

PhD in AI and Music, Queen Mary University of London

Sept 2021–present, expected Aug 2026

Modules: Deep Learning for Music, Machine Learning, Sound Recording and Production, Music Informatics. Fully funded by UKRI AIM-CDT and Steinberg Media Technologies GmbH.

MSc Physics, Pondicherry University

2018–2020 · First Class, 8.89/10

Modules: Non-Linear Dynamics, Electronics, Mathematical Physics. Funded by a Merit Scholarship at PU and the DST-Inspire Scholarship.

BSc Physics (Hons), Sri Sathya Sai Institute of Higher Learning

2015–2018 · Gold Medalist, Distinction, 8.6/10

Modules: Electronics, Mathematical Physics, Set Theory. Fully funded by SSSIHL and the DST-Inspire Scholarship.

Selected Publications

Loading publications…

See the full publications list for links and abstracts.

Mentoring

Teaching Fellow, Queen Mary University of London

2024–2026
  • Supervised 17 undergraduate final-year projects in machine learning and software development across two years.
  • Guided students on research design, ML experimentation, and academic/technical communication.
  • Themes included ML-based audio systems, computer vision apps, game platforms, and accessibility tools.
  • Supported taught modules as a teaching assistant: Professional and Research Practice (UG), Ethics, Regulation and Law in Advanced Digital Information Processing (PG), User Experience Design (UG/PG), Research Methods and Responsible Research (PG).
  • Notable project: Personalised Audio Deepfake Detection (Egor Vert), a two-stream WavLM and AASIST detector with per-speaker personalisation via FiLM conditioning, evaluated on the ASVspoof 2019 LA dataset.

Community Service & Participation

Selected Talks & Workshops

Tutorials and demos with their own publication are listed under Selected Publications above.

Other Interests

Music making: saxophone player, music production (Logic Pro, Ableton), song writing.
Analogue photography & darkroom: shooting 35mm film, B/W development and printing, member of Darkroom Socials (London) and Lakeside Darkroom.
Other: sourdough baking, fibre arts, art history, reading, travelling.