training smaller models to learn how to build bigger ones
GREG ROBERTS / HOUSTON, TEXAS
GREGROBERTS
I make things because I get bored.
Software engineer. Builder. Chronic rabbit-hole enjoyer.
01
CURRENT OBSESSION / 001
Microblade.
A tiny computer cluster that started as a reasonable idea and immediately stopped being one.
01CTRL
02WORK
03WORK
04WORK
clustered compute3D-printed racklocal AIway too many tiny screws
Status: physically becoming a problem
Enter MicrobladeTHE ONE THAT GOT OUT OF HAND
GregRietta
I wanted to understand language models better. So naturally I started building one.
Not a wrapper. Not a landing-page idea. An actual model, trained from the dirt up.
designed a rack because buying one would have been too reasonable
one question away from a four-hour detour
gym, country dancing, cooking, outside when the weather cooperates
RABBIT HOLE / HARDWARE01
I print the parts I wish existed.
Racks, sleds, cable management, weird little fixes. If the answer is a plastic rectangle with suspiciously specific dimensions, I will probably make it.
RABBIT HOLE / HOME02
There is an ocean in my living room.
Twenty gallons of saltwater, tiny animals with opinions, and a constant low-grade negotiation with algae.
RABBIT HOLE / FOOD03
Dinner can absolutely become a project.
Scratch-made ravioli, irresponsible burgers, steak nights, meal prep engineered like production software.
YOU MADE IT THIS FAR.
Anyway.
This is the part of the internet where I keep the things I can’t stop thinking about.