谷歌swish激活函数的keras实现

函数的keras实现"/>

谷歌swish激活函数的keras实现

swish激活函数的keras-tf实现
x * tf.sigmoid(beta * x)
或者
tf.nn.swish(x)

def swish(x):"""Swish activation function.      # Argumentsx: Input tensor.# ReturnsThe Swish activation: `x * sigmoid(x)`.# References[Searching for Activation Functions](.05941)"""if backend.backend() == 'tensorflow':try:# The native TF implementation has a more# memory-efficient gradient implementationreturn backend.tf.nn.swish(x)except AttributeError:passreturn x * backend.sigmoid(x)