函数的keras实现"/>
谷歌swish激活函数的keras实现
swish激活函数的keras-tf实现
x * tf.sigmoid(beta * x)
或者
tf.nn.swish(x)
def swish(x):"""Swish activation function. # Argumentsx: Input tensor.# ReturnsThe Swish activation: `x * sigmoid(x)`.# References[Searching for Activation Functions](.05941)"""if backend.backend() == 'tensorflow':try:# The native TF implementation has a more# memory-efficient gradient implementationreturn backend.tf.nn.swish(x)except AttributeError:passreturn x * backend.sigmoid(x)
更多推荐
谷歌swish激活函数的keras实现
发布评论