Thoughts on AI, career development, and life by Shaojie Jiang.https://shaojiejiang.github.io/https://shaojiejiang.github.io/blog/lessons-from-llm/https://shaojiejiang.github.io/blog/lessons-from-llm/Exploring what humans can learn from AI models like ChatGPT, examining both technical and philosophical implications of human-AI interaction.Sat, 27 Jan 2024 00:00:00 GMTPhilosophy of AICritical ThinkingExistential Inquiryhttps://shaojiejiang.github.io/blog/job-hunting-advice-2/https://shaojiejiang.github.io/blog/job-hunting-advice-2/Job seekers should focus on securing a single quality offer rather than pursuing multiple positions simultaneously.Sat, 25 Nov 2023 00:00:00 GMTJob HuntingCareer AdvicePersonal Developmenthttps://shaojiejiang.github.io/blog/job-hunting-advice/https://shaojiejiang.github.io/blog/job-hunting-advice/Some advice on LLM job hunt in 2023, covering preparation, strategy, and understanding the nuances of the job market.Sun, 12 Nov 2023 00:00:00 GMTJob HuntingLLM CareersCareer AdvicePersonal Developmenthttps://shaojiejiang.github.io/blog/creativity-training/https://shaojiejiang.github.io/blog/creativity-training/Ideas on how to redirect technology and gaming addiction toward productive outcomes, from AI-powered education to elderly companion bots.Sat, 23 Sep 2023 00:00:00 GMTCreativityAIIdeashttps://shaojiejiang.github.io/blog/responsible-aigac/https://shaojiejiang.github.io/blog/responsible-aigac/It is all about responsibility — reflecting on AI ethics, the adult industry, and what it means to be a responsible technologist.Wed, 20 Sep 2023 00:00:00 GMTResponsible AIPersonal Opinionshttps://shaojiejiang.github.io/blog/school-problems-china/https://shaojiejiang.github.io/blog/school-problems-china/Discovering that schools in China have banned unsupervised break times, restricting students to classrooms — and why this matters.Mon, 11 Sep 2023 00:00:00 GMTEducationCurrent AffairsPersonal Opinionshttps://shaojiejiang.github.io/blog/ai-gaming-era/https://shaojiejiang.github.io/blog/ai-gaming-era/Exploring how large language models and AI technologies are transforming video game development and player experiences.Sun, 13 Aug 2023 00:00:00 GMTDeep LearningNLPLLMVideo Gameshttps://shaojiejiang.github.io/blog/llm-hallucination/https://shaojiejiang.github.io/blog/llm-hallucination/Discussing how LLM hallucinations stem from exposure bias — both memorized knowledge and corpus-based heuristics from training data.Wed, 09 Aug 2023 00:00:00 GMTDeep LearningNLPLLMHallucinationInformation Retrievalhttps://shaojiejiang.github.io/blog/transformer-align-model/https://shaojiejiang.github.io/blog/transformer-align-model/Notes on training transformers to perform both translation and alignment tasks simultaneously.Sat, 16 May 2020 00:00:00 GMTDeep LearningNLPhttps://shaojiejiang.github.io/blog/compressive-transformers/https://shaojiejiang.github.io/blog/compressive-transformers/Notes on Compressive Transformers — a model that condenses old memories and stores them in compressed memory buffers for long-range sequence learning.Tue, 12 May 2020 00:00:00 GMTDeep LearningNLPhttps://shaojiejiang.github.io/blog/visualizing-loss/https://shaojiejiang.github.io/blog/visualizing-loss/Notes from the NeurIPS 2018 paper on why certain models train more easily and generalize better, through loss landscape visualization.Wed, 06 May 2020 00:00:00 GMTDeep Learninghttps://shaojiejiang.github.io/blog/adaptive-computation-time/https://shaojiejiang.github.io/blog/adaptive-computation-time/Notes on Adaptive Computation Time for Recurrent Neural Networks — comparing additive vs multiplicative halting probability approaches.Tue, 28 Apr 2020 00:00:00 GMTDeep Learninghttps://shaojiejiang.github.io/blog/transformer-blog-paper-hub/https://shaojiejiang.github.io/blog/transformer-blog-paper-hub/A curated collection of resources about transformer models, including illustrated guides, GNN connections, and architectural improvements.Mon, 02 Mar 2020 00:00:00 GMTDeep Learninghttps://shaojiejiang.github.io/blog/xlnet/https://shaojiejiang.github.io/blog/xlnet/Examining how XLNet improved upon BERT's architecture with Two-Stream Self-Attention and bidirectional data input.Thu, 20 Jun 2019 00:00:00 GMTNLPDeep LearningBERTTransformerXLNet