A bio-inspired bistable recurrent cell allows for long-lasting memory (Paper Explained)

Even though LSTMs and GRUs solve the vanishing and exploding gradient problems, they have trouble learning to remember things over very long time spans. Inspired by biology bi-stable cells hlwever…
Read more at YouTube…