publications | Soumya Sai Vanka

2024

The Role of Communication and Reference Songs in the Mixing Process: Insights From Professional Mix Engineers

Soumya Sai Vanka, Maryam Safi, Jean-Baptiste Rolland, and György Fazekas

Journal of the Audio Engineering Society, 2024

Abs Bib PDF

Effective music mixing requires technical and creative finesse, but clear communication with the client is crucial. The mixing engineer must grasp the client’s expectations and preferences and collaborate to achieve the desired sound. The tacit agreement for the desired sound of the mix is established using guides like reference songs and demo mixes exchanged between the artist and the engineer. This paper presents the findings of a two-phased exploratory study aimed at understanding howprofessionalmixing engineers interact with clients and use their feedback to guide the mixing process. For phase one, semistructured interviews were conducted with five mixing engineers with the aim of gathering insights about their communication strategies, creative processes, and decision-making criteria. Based on the inferences from these interviews, an online questionnairewas designed and administered to a larger group of 22 mixing engineers during the second phase. The results shed light on the importance of collaboration and intention in the mixing process and can inform the development of smart multitrack mixing systems. By highlighting the significance of these findings, this paper contributes to the research on the collaborative nature of music production and provides actionable recommendations for the design and implementation of innovative mixing tools.
@article{vanka2024role, author = {Vanka, Soumya Sai and Safi, Maryam and Rolland, Jean-Baptiste and Fazekas, György}, title = {The Role of Communication and Reference Songs in the Mixing Process: Insights From Professional Mix Engineers}, journal = {Journal of the Audio Engineering Society}, volume = {72}, number = {1/2}, pages = {5-15}, year = {2024}, publisher = {Audio Engineering Society}, url = {https://www.aes.org/e-lib/browse.cfm?elib=22374}, }

AI for Multitrack Mixing - A Hand’s On Workshop

Marco A. Martínez Ramírez, and Soumya Sai Vanka

In DaFx 2024 , Sep 2024

@inproceedings{vanka2023aimiy,
  title = {AI for Multitrack Mixing - A Hand's On Workshop},
  author = {Martínez Ramírez, Marco A. and Vanka, Soumya Sai},
  booktitle = {DaFx 2024},
  year = {2024},
  organization = {Digital Audio Effects Conference},
  month = sep,
  address = {Surrey, UK}
}

Diff-MST: Differentiable Mixing Style Transfer

Soumya Sai Vanka, Christian Rolland, Jean-Baptiste Rolland, Joshua Reiss, and 1 more author

In Proc. of the 25th Int. Society for Music Information Retrieval Conf. (ISMIR) , Nov 2024

Bib PDF

@inproceedings{vanka2023aimiz,
  title = {Diff-MST: Differentiable Mixing Style Transfer},
  author = {Vanka, Soumya Sai and Rolland, Steinmetz, Christian and Rolland, Jean-Baptiste and Reiss, Joshua and Fazekas, György},
  booktitle = {Proc. of the 25th Int. Society for Music Information Retrieval Conf. (ISMIR)},
  year = {2024},
  organization = {International Society for Music Information Retrieval},
  month = nov,
  address = {San Francisco, USA}
}

2023

Adoption of AI Technology in Music Mixing Workflow: An Investigation

Soumya Vanka, Maryam Safi, Jean-Baptiste Rolland, and György Fazekas

In 154th Audio Engineering Society Convention , Nov 2023

Abs Bib PDF

The integration of artificial intelligence (AI) technology in the music industry is driving a significant change in the way music is being composed, produced and mixed. This study investigates the current state of AI in the mixing workflows and its adoption by different user groups. Through semi-structured interviews, a questionnaire-based study, and analyzing web forums, the study confirms three user groups comprising amateurs, pro-ams, and professionals. Our findings show that while AI mixing tools can simplify the process and provide decent results for amateurs, pro-ams seek precise control and customization options, while professionals desire control and customization options in addition to assistive and collaborative technologies. The study provides strategies for designing effective AI mixing tools for different user groups and outlines future directions.
@inproceedings{sai2023adoption, title = {Adoption of {AI} Technology in Music Mixing Workflow: An Investigation}, author = {Vanka, Soumya and Safi, Maryam and Rolland, Jean-Baptiste and Fazekas, Gy{\"o}rgy}, booktitle = {154th Audio Engineering Society Convention}, year = {2023}, organization = {Audio Engineering Society}, url = {https://www.aes.org/e-lib/browse.cfm?elib=22060}, address = {Espoo, Finland}, }

AI for Multitrack Mixing - A Workshop

Soumya Sai Vanka, Christian J. Steinmetz, Marco A. Martínez Ramírez, Gary Bromham, and 3 more authors

In Audio Engineering Society Show NYC , Oct 2023

Bib PDF

@inproceedings{vanka2023aimix,
  title = {AI for Multitrack Mixing - A Workshop},
  author = {Vanka, Soumya Sai and Steinmetz, Christian J. and Martínez Ramírez, Marco A. and Bromham, Gary and Koo, Junghyun and DeMan, Brecht and Mourgella, Angeliki},
  booktitle = {Audio Engineering Society Show NYC},
  year = {2023},
  organization = {Audio Engineering Society},
  month = oct,
  address = {New York, USA}
}

2022

Deep Learning for Automatic Mixing

Christian J. Steinmetz, Soumya Sai Vanka, Marco A. Martínez Ramírez, and Gary Bromham

Dec 2022

Abs Bib PDF

Mixing is a central task within audio post-production where expert knowledge is required to deliver professional quality content, encompassing both technical and creative considerations. Recently, deep learning approaches have been introduced that aim to address this challenge by generating a cohesive mixture of a set of recordings as would an audio engineer. These approaches leverage large-scale datasets and therefore have the potential to outperform traditional approaches based on expert systems, but bring their own unique set of challenges. In this tutorial, we begin by providing an introduction to the mixing process from the perspective of an audio engineer, along with a discussion of the tools used in the process from a signal processing perspective. We then discuss a series of recent deep learning approaches and relevant datasets, providing code to build, train, and evaluate these systems. Future directions and challenges will be discussed, including new deep learning systems, evaluation methods, and approaches to address dataset availability. Our goal is to provide a starting point for researchers working in MIR who have little to no experience in audio engineering so they can easily begin addressing problems in this domain. In addition, our tutorial may be of interest to researchers outside of MIR, but with a background in audio engineering or signal processing, who are interested in gaining exposure to current approaches in deep learning.
@book{steinmetz2022automix, author = {Steinmetz, Christian J. and Vanka, Soumya Sai and Martínez Ramírez, Marco A. and Bromham, Gary}, month = dec, publisher = {Proc. of the 23rd Int. Society for Music Information Retrieval Conf. (ISMIR)}, title = {Deep Learning for Automatic Mixing}, year = {2022}, url = {https://dl4am.github.io/tutorial}, address = {Bengaluru, India}, }

2021

Intelligent Music Production: Music Production Style Transfer and Analysis of Mix Similarity

Soumya Vanka, Jean-Baptiste Rolland, and György Fazekas

In 16th Digital Music Research Network (DMRN+ 16) Workshop , Dec 2021

Bib PDF

@inproceedings{vankamst2021,
  title = {Intelligent Music Production: Music Production Style Transfer and Analysis of Mix Similarity},
  author = {Vanka, Soumya and Rolland, Jean-Baptiste and Fazekas, Gy{\"o}rgy},
  booktitle = {16th Digital Music Research Network (DMRN+ 16) Workshop},
  year = {2021},
  organisation = {Centre for Digital Music, QMUL},
  address = {London, UK},
}