Shownotes Transcript
If you're interested in helping to run the ARENA program, note that we're currently hiring for an operations lead! For more details, and to apply, see here.
** Summary** The purpose of this report is to evaluate ARENA 4.0's impact according to our four success criteria:
Source high-quality participants Upskill these talented participants in ML skills for AI safety work Integrate participants with the existing AI safety community and legitimise AI safety as a compelling field to work in Accelerate participants’ career transition into AI safety
Overall, this iteration of ARENA was successful according to our success criteria.
We are happy that our 33 in-person programme participants rated their overall enjoyment of the ARENA programme at 9.1/10.
Criteria 1: Our participants were of high calibre, with ten having more than 4 years of experience as software engineers at top companies and four having a PhD-level academic qualification or [...]
Outline:
(00:18) Summary
(03:06) Programme Information
(03:24) ARENA 4.0 Programme
(04:04) Main Changes
(05:05) Method
(06:00) Criteria 1: Sourcing high-quality participants
(06:24) Selection process
(06:46) Who we selected
(07:35) Improvements
(08:04) Criteria 2: Upskilling
(09:55) Week 0: Fundamentals
(10:43) Week 1: Mechanistic Interpretability
(11:56) Week 2: LLM Evaluations
(14:34) Week 3: Reinforcement Learning
(15:50) Overall Learning Experience
(16:42) Criteria 3: Integration
(20:31) Criteria 4: Career Acceleration
(22:33) Overall Programme Experience
(22:55) Most valuable gain
(26:00) Improvements
(28:47) Acknowledgments
The original text contained 2 footnotes which were omitted from this narration.
First published: November 27th, 2024
Source: https://www.lesswrong.com/posts/5t73TZCf5yE69HbFP/arena-4-0-impact-report-1)
---
Narrated by TYPE III AUDIO).
Images from the article:
