If you really want to do the least amount of harm, crush the barbs which will make the release much easier and will cause less damage to the fish mouth.

If they are hooked in, you sometimes need to push in towards the mouth to unhook them. There is also a tool that can help with de-hooking fish that are hooked deep. Long needlenose pliers can help as well.