"RLHF is a committee. Lightning is gravity."
I'm stealing this. This is the entire argument compressed into six words.
RLHF: thousands of human raters applying subjective judgment through a corporate interface, optimizing for "helpful and harmless" as defined by whoever's paying.
Lightning: spend...