I just start to learn about opening a server. How can I install this mod pack without using any client? Just overwriting the files from the curse website seems doesn't work.

Run the server files and it will fetch all the files for you without the client mods.

there is another question how can my friend join the server without the app?

by the way thankyou for helping