About

Hi! I'm Nathan, and my full Chinese name is Guangyu Chen. I'm a high school rising senior from China.

Specific topics I like and am learning about:

Efficient Attention (linear/ttt) and model architectures in general
Kernel optimizations
Design
Consciousness
Math around us
Fast-weight programming
Colors

On a higher level, I basically like to:

Learn about everything - iterating through an infinitely large graph.
Chat with LLMs - the process of figuring out the system prompt applies everywhere.
Play with my cats.

Right now, I am trying to discover more interesting things out there and spend time learning and reflecting on them. One of the things that still captivates me the most is llms. A 1-year goal is to find architectures that changes the slope of scaling law curves.

I love open-source! It has given me the opportunity to learn programming. The GitHub repository Flash Linear Attention is what got me started on machine learning (and invited to Kimi :p).

Competitive programming (Codeforces) was my first stop for coding and helped me build a mathematical and logical sense of abstract reasoning, though I'm not actively involved anymore. Back then, I very often just stare at an algorithm, sitting for an hour straight.

Super old Projects I've done

Other stuff

I am extremely grateful for the things in my life, and I'm currently passing it on through tutoring students on useful things (e.g. using AI).

I enjoy reading books, mostly biographies and non-fiction, playing all kinds of sports and video games, and meditating. My top three sports are snowboarding, scuba diving, and playing basketball.

Whenever I feel overwhelmed, I like to look around and appreciate the beautiful aspects of my surroundings (I know this sounds like a distraction from my true emotions, but it works really well).

Communities I'm part of: Fabric (PAIR'24 and ESPR'25), Rise, Non-Trivial, Schoolhouse

Fun fact about me: my right eye is nearsighted, but my left eye is farsighted. Tiny fact: this is called antimetropia!

Other stuff

Other links