We present squareplus, an activation function that resembles softplus, but which can be computed using only algebraic operations: addition, multiplication, and square-root. Because squareplus is ~6x faster to evaluate than softplus on a CPU and does not require access to transcendental functions, it may have practical value in resource-limited deep learning applications.

翻译：平方+是一个类似于软+的激活功能,但只能使用代数操作来计算:添加、乘法和平方根。 因为平方+比CPU的软+快于~6x,而且不需要超常功能,因此在资源有限的深层学习应用中它可能具有实际价值。