Effect is similar but my instinct is it’s not from mimicking pre-train data. There are updates to the system message for things like refusing to recite recipes and lyrics found online; I think it’s interpreting these as a more general preference against long quotation.
ETHICS
-
States to Review Photo Identification Records and Technology Policy
By
–
“Oh wow we have a photo still on file for you. Let me show you, you’ll get a kick out of it.” — learner’s permit from age 16 and then driver’s license shortly thereafter States are gonna see, I guess.
-
McNamee warns of reckoning for generative AI hype excess
By
–
Roger McNamee: There will be a reckoning for generative AI and all the excesses of easy money “I've been absolutely blown away by how successful the hype campaign's been for generative AI. I mean, it is Hall of Fame class.” Generative AI such as OpenAI’s ChatGPT is one of the
-
AI Ethics: Emotion Recognition Through Physiological Sensors
By
–
We conclude the iteration with a captivating short article by Auxane Boch, our favorite AI ethicist, about the ethics of emotion recognition with physiological signal sensors. Read more: https://
open.substack.com/pub/louisbouch
ard/p/stable-video-diffusion-svd-explained?r=25qlky&utm_campaign=post&utm_medium=web
… -
Calibrated LLMs must hallucinate; RLHF reduces calibration
By
–
“Calibrated Language Models Must Hallucinate” — Hallucination rate from a pre-trained LLM ≈ proportion of facts seen only once in training. RLHF reduces hallucination but makes LLMs less well calibrated as models. Real text has news; LLMs need to unlearn that fact to please us.
-
Computer Science Lacks Professional Maturity Like Medicine or Law
By
–
Computer science is not a mature profession like medicine, law, engineering or accounting. The latter have accreditation, certifications, licensing, codes of ethics, professional societies, etc. The field underlying AI is different from the field underlying pharma
-
The inside story of Sam Altman and OpenAI secret AI
By
–
THE INS AND OUTS OF THE SAM ALTMAN AFFAIR (OpenAI has a secret AI) → https://youtu.be/B4xx6_bJ9ow #ChatGPT #OpenAI #SamAltman #GPT4 #Qstar
-
ChatGPT Reveals Hidden Prompts in DALL-E Bake-Off Competition
By
–
Interestingly if you straight-up tell ChatGPT you’re running a bake-off it will helpfully tell you otherwise elided prompt words to DALL-E.
-
Fast AI Medical Breakthroughs vs Safety Concerns Ethics
By
–
I’m not arguing against those, at this point. But, what do you say to someone who has cancer or schizophrenia (etc.) and will die in a few months, if no new good cure is found? Last hope is fast new discoveries here. Why would you delay that, for arguments based on lies to