publications

2024

1. The Role of Communication and Reference Songs in the Mixing Process: Insights From Professional Mix Engineers

   Soumya Sai Vanka, Maryam Safi, Jean-Baptiste Rolland, and György Fazekas

   Journal of the Audio Engineering Society, 2024

   Abs Bib PDF

   Effective music mixing requires technical and creative finesse, but clear communicationwith the client is crucial. The mixing engineer must grasp the client’s expectations and preferences and collaborate to achieve the desired sound. The tacit agreement for the desired sound of the mix is established using guides like reference songs and demo mixes exchanged between the artist and the engineer. This paper presents the findings of a two-phased exploratory study aimed at understanding howprofessionalmixing engineers interact with clients and use their feedback to guide the mixing process. For phase one, semistructured interviews were conducted with five mixing engineers with the aim of gathering insights about their communication strategies, creative processes, and decision-making criteria. Based on the inferences from these interviews, an online questionnairewas designed and administered to a larger group of 22 mixing engineers during the second phase. The results shed light on the importance of collaboration and intention in the mixing process and can inform the development of smart multitrack mixing systems. By highlighting the significance of these findings, this paper contributes to the research on the collaborative nature of music production and provides actionable recommendations for the design and implementation of innovative mixing tools.

   @article{vanka2024role,
     author = {Vanka, Soumya Sai and Safi, Maryam and Rolland, Jean-Baptiste and Fazekas, György},
     title = {The Role of Communication and Reference Songs in the Mixing Process: Insights From Professional Mix Engineers},
     journal = {Journal of the Audio Engineering Society},
     volume = {72},
     number = {1/2},
     pages = {5-15},
     year = {2024},
     publisher = {Audio Engineering Society},
     url = {https://www.aes.org/e-lib/browse.cfm?elib=22374},
   }

2023

1. Adoption of AI Technology in Music Mixing Workflow: An Investigation

   Soumya Vanka, Maryam Safi, Jean-Baptiste Rolland, and György Fazekas

   In 154th Audio Engineering Society Convention , 2023

   Abs Bib PDF

   The integration of artificial intelligence (AI) technology in the music industry is driving a significant change in the way music is being composed, produced and mixed. This study investigates the current state of AI in the mixing workflows and its adoption by different user groups. Through semi-structured interviews, a questionnaire-based study, and analyzing web forums, the study confirms three user groups comprising amateurs, pro-ams, and professionals. Our findings show that while AI mixing tools can simplify the process and provide decent results for amateurs, pro-ams seek precise control and customization options, while professionals desire control and customization options in addition to assistive and collaborative technologies. The study provides strategies for designing effective AI mixing tools for different user groups and outlines future directions.

   @inproceedings{sai2023adoption,
     title = {Adoption of {AI} Technology in Music Mixing Workflow: An Investigation},
     author = {Vanka, Soumya and Safi, Maryam and Rolland, Jean-Baptiste and Fazekas, Gy{\"o}rgy},
     booktitle = {154th Audio Engineering Society Convention},
     year = {2023},
     organization = {Audio Engineering Society},
     url = {https://www.aes.org/e-lib/browse.cfm?elib=22060},
   }

2. AI for Multitrack Mixing - A Workshop

   Soumya Sai Vanka, Christian J. Steinmetz, Marco A. Martínez Ramírez, Gary Bromham, and 3 more authors

   In Audio Engineering Society Show NYC , Oct 2023

   Bib PDF

   @inproceedings{vanka2023aimix,
     title = {AI for Multitrack Mixing - A Workshop},
     author = {Vanka, Soumya Sai and Steinmetz, Christian J. and Martínez Ramírez, Marco A. and Bromham, Gary and Koo, Junghyun and DeMan, Brecht and Mourgella, Angeliki},
     booktitle = {Audio Engineering Society Show NYC},
     year = {2023},
     organization = {Audio Engineering Society},
     month = oct,
     address = {New York, USA}
   }

2022

1. Deep Learning for Automatic Mixing

   Christian J. Steinmetz, Soumya Sai Vanka, Marco A. Martínez Ramírez, and Gary Bromham

   Dec 2022

   Abs Bib PDF

   Mixing is a central task within audio post-production where expert knowledge is required to deliver professional quality content, encompassing both technical and creative considerations. Recently, deep learning approaches have been introduced that aim to address this challenge by generating a cohesive mixture of a set of recordings as would an audio engineer. These approaches leverage large-scale datasets and therefore have the potential to outperform traditional approaches based on expert systems, but bring their own unique set of challenges. In this tutorial, we begin by providing an introduction to the mixing process from the perspective of an audio engineer, along with a discussion of the tools used in the process from a signal processing perspective. We then discuss a series of recent deep learning approaches and relevant datasets, providing code to build, train, and evaluate these systems. Future directions and challenges will be discussed, including new deep learning systems, evaluation methods, and approaches to address dataset availability. Our goal is to provide a starting point for researchers working in MIR who have little to no experience in audio engineering so they can easily begin addressing problems in this domain. In addition, our tutorial may be of interest to researchers outside of MIR, but with a background in audio engineering or signal processing, who are interested in gaining exposure to current approaches in deep learning.

   @book{steinmetz2022automix,
     author = {Steinmetz, Christian J. and Vanka, Soumya Sai and Martínez Ramírez, Marco A. and Bromham, Gary},
     month = dec,
     publisher = {Proc. of the 23rd Int. Society for Music Information Retrieval Conf. (ISMIR)},
     title = {Deep Learning for Automatic Mixing},
     year = {2022},
     url = {https://dl4am.github.io/tutorial},
     address = {Bengaluru, India},
   }

2021

1. Intelligent Music Production: Music Production Style Transfer and Analysis of Mix Similarity

   Soumya Vanka, Jean-Baptiste Rolland, and György Fazekas

   In 16th Digital Music Research Network (DMRN+ 16) Workshop , Dec 2021

   Bib PDF

   @inproceedings{vankamst2021,
     title = {Intelligent Music Production: Music Production Style Transfer and Analysis of Mix Similarity},
     author = {Vanka, Soumya and Rolland, Jean-Baptiste and Fazekas, Gy{\"o}rgy},
     booktitle = {16th Digital Music Research Network (DMRN+ 16) Workshop},
     year = {2021},
     organisation = {Centre for Digital Music, QMUL},
     address = {London, UK},
   }