38 lines
458 B
Plaintext
38 lines
458 B
Plaintext
.. _layers:
|
|
|
|
.. currentmodule:: mlx.nn
|
|
|
|
Layers
|
|
------
|
|
|
|
.. autosummary::
|
|
:toctree: _autosummary
|
|
:template: nn-module-template.rst
|
|
|
|
ALiBi
|
|
BatchNorm
|
|
Conv1d
|
|
Conv2d
|
|
Dropout
|
|
Dropout2d
|
|
Dropout3d
|
|
Embedding
|
|
GELU
|
|
GroupNorm
|
|
InstanceNorm
|
|
LayerNorm
|
|
Linear
|
|
Mish
|
|
MultiHeadAttention
|
|
PReLU
|
|
QuantizedLinear
|
|
RMSNorm
|
|
ReLU
|
|
RoPE
|
|
SELU
|
|
Sequential
|
|
SiLU
|
|
SinusoidalPositionalEncoding
|
|
Step
|
|
Transformer
|