The CurseForge automatic packaging feature is useful and a convenient thing to get set up. The packaging settings for the project can be found here:
https://www.curseforge.com/wow/addons/easy-roll-tracker/settings/source

The documentation for the automatic packaging feature can be found here:
https://authors.curseforge.com/knowledge-base/projects/3451-automatic-packaging

Automatic packaging has strict requirements on changelogs, and doesn't allow manual editing of them. Although this would be a convenient feature to have, due to the not-actually-documentation and the strict nature of CHANGELOG.txt this is not a good feature to implement at this time.

This issue can be reopened in the future if CurseForge makes relevant changes (e.g. a documentation update or some API change due to the Overwolf acquisition).

"Package tagged commits" is probably the option that fits the best.