Blog

Thoughts on AI, career development, and life.

RSS Feed

Popular Topics

Jan 27, 20242 min read
AI

What Can Humans Learn FROM AI Models?

Exploring what humans can learn from AI models like ChatGPT, examining both technical and philosophical implications of human-AI interaction.

Philosophy of AICritical ThinkingExistential Inquiry
Read post
What Can Humans Learn FROM AI Models?
Nov 25, 20232 min read
Career

Fun Fact: One Good Job Offer Is All You Need

Job seekers should focus on securing a single quality offer rather than pursuing multiple positions simultaneously.

Job HuntingCareer AdvicePersonal Development
Read post
Fun Fact: One Good Job Offer Is All You Need
Nov 12, 20237 min read
Career

Navigating The Job Hunting Maze

Some advice on LLM job hunt in 2023, covering preparation, strategy, and understanding the nuances of the job market.

Job HuntingLLM CareersCareer AdvicePersonal Development
Read post
Navigating The Job Hunting Maze
Sep 23, 20232 min read
Ideas

Notes for Creativity Training

Ideas on how to redirect technology and gaming addiction toward productive outcomes, from AI-powered education to elderly companion bots.

CreativityAIIdeas
Read post
Notes for Creativity Training
Sep 20, 20232 min read
AI Ethics

Job Invitations From Adult Industry Are Welcome, but Not in the Way You Are Thinking Of

It is all about responsibility — reflecting on AI ethics, the adult industry, and what it means to be a responsible technologist.

Responsible AIPersonal Opinions
Read post
Job Invitations From Adult Industry Are Welcome, but Not in the Way You Are Thinking Of
Sep 11, 20232 min read
Education

Break Time Banned in Chinese Schools. What Now?

Discovering that schools in China have banned unsupervised break times, restricting students to classrooms — and why this matters.

EducationCurrent AffairsPersonal Opinions
Read post
Break Time Banned in Chinese Schools. What Now?
Aug 13, 20232 min read
AI

Has the AI-Era Come to Video Games Already?

Exploring how large language models and AI technologies are transforming video game development and player experiences.

Deep LearningNLPLLMVideo Games
Read post
Has the AI-Era Come to Video Games Already?
Aug 9, 2023< 1 min read
AI

One Source of LLM Hallucination Is Exposure Bias

Discussing how LLM hallucinations stem from exposure bias — both memorized knowledge and corpus-based heuristics from training data.

Deep LearningNLPLLMHallucination
Read post
One Source of LLM Hallucination Is Exposure Bias
May 16, 2020< 1 min read
Paper Notes

Transformer Align Model

Notes on training transformers to perform both translation and alignment tasks simultaneously.

Deep LearningNLP
Read post
May 12, 20202 min read
Paper Notes

Compressive Transformers

Notes on Compressive Transformers — a model that condenses old memories and stores them in compressed memory buffers for long-range sequence learning.

Deep LearningNLP
Read post
Compressive Transformers
May 6, 2020< 1 min read
Paper Notes

Visualizing the Loss Landscape of Neural Nets

Notes from the NeurIPS 2018 paper on why certain models train more easily and generalize better, through loss landscape visualization.

Deep Learning
Read post
Visualizing the Loss Landscape of Neural Nets
Apr 28, 20202 min read
Paper Notes

Adaptive Computation Time

Notes on Adaptive Computation Time for Recurrent Neural Networks — comparing additive vs multiplicative halting probability approaches.

Deep Learning
Read post
Mar 2, 2020< 1 min read
Resources

A Hub for Transformer Blogs and Papers

A curated collection of resources about transformer models, including illustrated guides, GNN connections, and architectural improvements.

Deep Learning
Read post
Jun 20, 2019< 1 min read
Paper Notes

What's New in XLNet?

Examining how XLNet improved upon BERT's architecture with Two-Stream Self-Attention and bidirectional data input.

NLPDeep LearningBERTTransformer
Read post
What's New in XLNet?