Image for post
Image for post

A quick foray into the foundations of learning

It’s late 2019 and the hype around Machine Learning has grown to unreasonable proportions. It seems like every week a new state of the art result is reported, a slicker Deep Learning library surfaces on GitHub, and OpenAI releases a GPT-2 model with more parameters. With the mind-bending results we’ve seen so far, it’s hard not to get swept up in the hype.

Others, however, warn that Machine Learning has overpromised and underdelivered. They worry that such continued action could cause research funding to dry up, leading to another Artificial Intelligence winter. This would be bad news indeed. …


Image for post
Image for post

How to add sugar to the Python syntax with main wrappers

I love Python. It’s an extremely powerful language that’s very simple to write and understand. It also has an extensive ecosystem of libraries that allow you to do pretty much anything you can think of (even fly). Recently, it has become the lingua franca of Data Science and Machine Learning. I use it constantly in my day job, so I’d say I’m fairly proficient at it (I do have Python readability at Google after all 😏¹).

However, Python is not perfect. I’ve recently started learning Lisp in my free time.² While learning, I stumbled across what I think is a…


Image for post
Image for post

A high level primer on language models and OpenAI’s GPT-2

The Beatles were a huge cultural phenomenon. Their timeless music still resonates with people today, both young and old. Personally, I’m a big fan. In my humble opinion, they are the greatest band to have ever lived¹. Their songs are full of interesting lyrics and deep ideas. Take these bars for example:

When you’ve seen beyond yourself
Then you may find peace of mind is waiting there²

Powerful stuff. However, the thing that made the Beatles great was their versatility. Some of their songs are deep and thoughtful while others are fun and lighthearted. Unsurprisingly, the biggest theme that weaves…


Image for post
Image for post

It’s not rocket science, it’s control theory

I spend way too much time on YouTube… probably much more than I’d like to admit. For all of its shortcomings, YouTube has a lot of very interesting content from dedicated and passionate creators. Every so often I’ll run across a video that sparks an idea for something I want to try. One such video I recently came across was this SpaceX propulsion test of their Dragon 2 spacecraft.

What stands out to me in particular about this video is that the spacecraft uses its boosters to perfectly hover a…


Image for post
Image for post

How to build a smarter test for password strength

I recently came across an extremely useful tool for checking the quality of your passwords, haveibeenpwned.com. You type in a password and it automatically gets checked against a database of ~500M leaked passwords. If any matches were found, you should p̶r̶o̶b̶a̶b̶l̶y̶ definitely change your password.

Let’s see what happens when we try the classic correcthorsebatterystaple.

Eugen Hotaj

Machine Learning at Facebook AI. Previously at Google Research.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store