5e430fd001c839b4f35cb0ceeba467687449a455,thinc/layers/mish.py,,Mish,#,17

Before Change

    Dense layer with mish activation.
    https://arxiv.org/pdf/1908.08681.pdf
    
    model: Model[InT, OutT] = Model(
        "mish",
        forward,
        init=create_init({"W": init_W, "b": init_b}),
        dims={"nO": nO, "nI": nI},
        params={"W": None, "b": None},
    )

After Change

    Dense layer with mish activation.
    https://arxiv.org/pdf/1908.08681.pdf
    
    model: Model[InT, OutT] = Model(
        "mish",
        forward,
        init=partial(init, init_W, init_b),
        dims={"nO": nO, "nI": nI},
        params={"W": None, "b": None},
    )

Instances