Summer Internship work is out in ICLR! Automatic architecture search finds non-intuitive (at least to me) architecture including sine curves and division.
I’m really glad to have worked with a fantastic team at Salesforce Research, most closely with Stephen Merity and Richard Socher.
Blog: https://einstein.ai/research/domain-specific-language-for-automated-rnn-architecture-search
Paper + Reviews: https://openreview.net/forum?id=SkOb1Fl0Z