| Random Link ¯\_(ツ)_/¯ | ||
| Mar 3, 2021 | » | LLMs: Stochastic Parrots 🦜 and How (Not) to Use Them
10 min; updated Dec 14, 2023
|
| May 2, 2020 | » | On Learning
11 min; updated May 27, 2023
Mental Attitude While LearningDistinguish Mere Facts From Conclusions or OpinionsDiscriminate between mere statements of facts, necessary conclusions which follow therefrom, and mere opinions which they seem to render reasonable. There’s no need to perform an experiment to verify that the atomic weight of oxygen is 16. That the sum of the angles of a plane triangle equals two right angles is not a mere fact, but an inevitable truth. ... |
| Jun 15, 2021 | » | Thoughts on Academic Research
7 min; updated Dec 3, 2022
Why Even Read Papers?While tutorials and docs help you write code right now, the academic papers can help you understand where programming came from and where it’s going. You also understand the paths that foundational academic research did not take. There’s a lot of things that are old that are new again, over and over and over. The idea of Stack Overflow is that someone else has had your problem before; the idea of academic papers is that someone else has thought about this problem before. ... |
| Oct 7, 2020 | » | Fables in Service of Capitalism
4 min; updated Sep 5, 2022
EnvironmentalismOver the last 70 years, less than 10% of plastic waste has been recycled - it’s uneconomical. Recycling shifts attention from the environmental impact of plastics and their overproduction to the consumer’s willingness to recycle. Reducing and reusing is a much better environmental strategy. #environmentalism Betting (and Gambling)I’m seeing more prominent gambling sites and ads compared to when I was growing up. Based on my peers, SportPesa made lots of headway in Kenya (few companies can claim to sponsor English Premier League teams). Its backing is foreign though, so maybe SportPesa is part of a global trend? ... |
| May 10, 2022 | » | TV and Film
3 min; updated Sep 5, 2022
Crime DramaOzark’s highlights are Ruth Langmore’s 90s’ hip hop playlist, Wendy Byrde’s sociopathic ambition, and Del Rio’s suave. The show follows the Byrde family that has to launder money for the Navarro Cartel. The writers use shortcuts as the show proceeds, and grant excessive plot armor for the Byrde family in subsequent seasons. ’s Bill Dubuque also wrote The Accountant (2016 Film) , which follows a CPA with high-functioning autism who makes his living by uncooking the books of criminal organizations experiencing internal embezzlement. Might be worth looking into. ... |
was written in a period when NLP practitioners are producing bigger (# of parameters; size of training data) language models (LMs), and pushing the top scores on benchmarks. The paper itself was controversial because it led to Gebru being fired from Google, following disagreements with her managers on conditions (withdraw, or remove Google-affiliated authors) for publishing the paper.
A lot changed since mid-2021, when I initially wrote this page. OpenAI’s ChatGPT took the world by storm – reaching 123m MAU less than 3 months after launch and becoming the fastest-growing consumer application in history (TikTok took 9 months to hit 100m MAU).
...