neural_tangents.stax.Relu

neural_tangents.stax.Relu(do_stabilize=False)[source]

ReLU nonlinearity.

Parameters:

do_stabilize (bool) – set to True for very deep networks.

Return type:

tuple[InitFn, ApplyFn, LayerKernelFn]

Returns:

(init_fn, apply_fn, kernel_fn).