This is something that I first noticed while reading some physics textbooks that are on the slightly older side. Many authors use brackets, and sometimes even braces, to avoid having nesting parentheses. For example:
Is anybody aware of an existing convention for this? I see that many authors don't do this, but I personally find this kind of notation much easier to read.