Then you would use it as activation function. To use it as base function, you need to implement it a bit different. I also wanted to do more hands-on approach because this was for my master thesis. But if I would implement it now, I would just use torch sin if I want to use it as activation function, or combine linear with torch sin to use it as base.