why don’t we have video game engines that can do full riemannian geometry? would be so cool. hyperbolica should be more common. don’t you all want to see what lines could look like?

Random Thought: LC Theorem

The PACELC theorem seems awfully named to me.

I finally have an answer to "who's your favorite singer?"

Nusrat Fateh Ali Khan.

My Top Tip for Helping People Get Started Programming

Set up their shell, PATH, and dependencies. Have them use VS Code, and if there’s any tooling issues, tell them you’ll fix it. Saves months of frustration and time. Learning that stuff up front sucks.


My main thought about papers like this is how it affects my own future lines of inquiry. Makes me lean into “cleverness” areas more since I currently lack the compute to do this style of inquiry. I expect other researchers have run it through their own internal calculus too.

Random paper on angles

You can define angle in any Hilbert space as the arccos of the inner product over product of norms. I was wondering about doing it in Banach spaces (like \(C[0,1]\)).

An Image is Worth 16x16 Words

Transformer gives you function \(F: [X] \to [Y]\). Anything that can be totally ordered can be learned. So it’s pretty general.

Random stuff

I just made the slug for these URLs random since I’m sick of caring about them. Search is good enough to not have to care.

Lossless Data Compression with Neural Networks by Fabrice Bellard

Unknown among my community, Fabrice Bellard is someone I aspire to be a third as productive as.

Downscaling Numerical Weather Models With GANs (My CI 2019 Paper)

I saw some people on Twitter recently talking about work that’s similar to stuff I’d done last year (~April 2019). For a moment, I felt annoyance that I wasn’t cited, but then that quote about standing on each other’s shoulders and not each others’ toes came to mind, so I decided to blog about the paper since my marketing clearly wasn’t good enough.

Learning Differential Forms and Questions

After years of putting it off, I finally prepaid a tutor to force me to actually read about differential forms.

PyTorch Lightning is worth using

The one PyTorch framework that doesn’t drown me in bureaucracy, though it’s buggy as hell since features seem to be added with about 10 seconds of consideration.

Feynman Lectures, Chapter 2

Tries to give the ultimate top down view of physics, as of 1960. Thankfully it’s not The Road to Reality.

Feynman Lectures 1

  • He’s honest about intentions (this book is for aspiring physicists)
    • Sucks if that’s not you I guess
  • I feel sorry for the students who took it for a grade
  • It blows my mind just how well certain things are known (like the fact that the angle between hydrogen atoms in water is 105 degrees and 3 minutes)

Random Julia Thoughts

  • Nesting function calls is ugly IMO compared to dot chaining.
  • I like that broadcasting is explicit, I think Mat + Vec should be a type error.
  • I wish it had auto-currying. I wish all languages did.
  • I wish there were tagged unions.
  • Multiple dispatch is slick, and a natural fit for math, though I wonder how much/if specialization issues like what Rust’s been plagued with are issues in Julia.
  • Custom operators are nice
  • I don’t like begin/end, I’m fine with curly braces or something, though they do look pretty on generics (but so do square brackets)
  • Julia used * for string concatenation because strings are a monoid, so they seem to care about mathematical convention. Why not use arr(i) to emphasize that array access is a function from the naturals to your input set?
  • Don’t care about 0 or 1-indexing.
  • Zygote/Flux is so cool.
  • Chris Rackauckas is a mensch.
    • His arguments about how Julia enables building good packages, which is what scientists want even harder than most developers, will be a big advantage.
  • I don’t like ternary operator. Make conditionals an expressions.
  • I think I’d still like it if Swift with some sort of value-based generics was the default ML language (or really a go-to language in general). If only it wasn’t so tied to macOS.

Death Still Sucks

My friend, Adrian Albert, was killed in a car crash 2 months ago.