astralcodexten.substack.com

was written in a period when NLP practitioners are producing bigger (# of parameters; size of training data) language models (LMs), and pushing the top scores on benchmarks. The paper itself was controversial because it led to Gebru being fired from Google, following disagreements with her managers on conditions (withdraw, or remove Google-affiliated authors) for publishing the paper. A lot changed since mid-2021, when I initially wrote this page....

Mental Attitude While Learning Distinguish Mere Facts From Conclusions or Opinions Discriminate between mere statements of facts, necessary conclusions which follow therefrom, and mere opinions which they seem to render reasonable. There’s no need to perform an experiment to verify that the atomic weight of oxygen is 16. That the sum of the angles of a plane triangle equals two right angles is not a mere fact, but an inevitable truth....

Going to a talk is difficult for everyone because nobody understands the whole thing, but it’s especially difficult for undergraduates because they still expect to. is a rich resource for understanding scholarly literature. Browse it. Some of the listed items are familiar, e.g. Google Scholar, SCImago, Sci-Hub, but it’d be informative to zoom out to the larger picture, e.g. good alternatives to Google Scholar. Why Even Read Papers?...

Environmentalism Over the last 70 years, less than 10% of plastic waste has been recycled - it’s uneconomical. Recycling shifts attention from the environmental impact of plastics and their overproduction to the consumer’s willingness to recycle. Reducing and reusing is a much better environmental strategy. #environmentalism Betting (and Gambling) I’m seeing more prominent gambling sites and ads compared to when I was growing up. Based on my peers, SportPesa made lots of headway in Kenya (few companies can claim to sponsor English Premier League teams)....

Crime Drama Ozark’s highlights are Ruth Langmore’s 90s' hip hop playlist, Wendy Byrde’s sociopathic ambition, and Del Rio’s suave. The show follows the Byrde family that has to launder money for the Navarro Cartel. The writers use shortcuts as the show proceeds, and grant excessive plot armor for the Byrde family in subsequent seasons. ’s Bill Dubuque also wrote The Accountant (2016 Film) , which follows a CPA with high-functioning autism who makes his living by uncooking the books of criminal organizations experiencing internal embezzlement....