Is there a way to make a config setting that only shows up if another setting is toggled on? Couldn't seem to find it in the documentation

ValidatedCondition is what you are looking for. Lets you wrap a setting with one or more conditional checks; if any of those fail, the setting is disabled and non-user-editable

You can set up a condition using toCondition from any ValidatedField. (ValidatedBoolean settings are directly passable into this)

Validated Condition