Skip to content

Commit 32b3f65

Browse files
junwei-panrmlarsen
authored andcommitted
Add and update reference for crelu and relu6 (tensorflow#9803)
1 parent a8271ea commit 32b3f65

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tensorflow/python/ops/nn_ops.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1324,7 +1324,7 @@ def crelu(features, name=None):
13241324
Concatenates a ReLU which selects only the positive part of the activation
13251325
with a ReLU which selects only the *negative* part of the activation.
13261326
Note that as a result this non-linearity doubles the depth of the activations.
1327-
Source: https://arxiv.org/abs/1603.05201
1327+
Source: [Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units. W. Shang, et al.](https://arxiv.org/abs/1603.05201)
13281328
13291329
Args:
13301330
features: A `Tensor` with type `float`, `double`, `int32`, `int64`, `uint8`,
@@ -1342,6 +1342,7 @@ def crelu(features, name=None):
13421342

13431343
def relu6(features, name=None):
13441344
"""Computes Rectified Linear 6: `min(max(features, 0), 6)`.
1345+
Source: [Convolutional Deep Belief Networks on CIFAR-10. A. Krizhevsky](http://www.cs.utoronto.ca/~kriz/conv-cifar10-aug2010.pdf)
13451346
13461347
Args:
13471348
features: A `Tensor` with type `float`, `double`, `int32`, `int64`, `uint8`,

0 commit comments

Comments
 (0)