My guess is this is InstructGPT/RLHF rather than anything in the pre-training corpus. Tuning implicitly makes it assume all questions are answerable — it sees all text as “ ” and Q/A is a subset of that.
ETHICS
-
Stable Diffusion 2.0 Shows Quality Decline Compared to 1.5
By
–
plot twist: stable diffusion 2.0 looks quite a bit worse on the few prompts i've tried so far compared to 1.5 (even not including celebrities/artists). Running theory seems to be this is due to an aggressive data sanitization campaign since the original release (?).
-
Wealth Redistribution and Indigenous Rights: A 2023 Vision
By
–
2023 – the year that people start loving themselves enough to say, “hey, 50 richest people in the world – give up 90% of your wealth & save the world after recognizing and honoring the indigenous & marginalized people who have been ignored for decades!” It will be a good year.
-
Tools Progress Cannot Eliminate Essential Complexity in Masterwork Creation
By
–
Every John Henry will eventually fall to more powerful tools, but many tasks will still have an essential complexity that is still daunting even after removing all the ephemeral issues, so I am dubious about any random person being able to create masterworks.
-
CSRanking’s Professor-Only Requirement Excludes Quality Researchers
By
–
One issue is that CSRanking demands that researchers have a Prof. title when listed, some good researchers like my supervisor (typically in Europe I guess), who actually serve as PIs to supervise PhD students, are unable to be listed there.
-
First Class Action Lawsuits Filed Against GitHub Copilot
By
–
The first class action lawsuits against GitHub Copilot have been filed https://actuia.com/actualite/les-premieres-plaintes-collectives-contre-github-copilot-ont-ete-deposees/
… #AI #artificialintelligence #code -
AI naming could have been worse with consciousness mechanics
By
–
It could have been worse. AI could have been called consciousness mechanics.
-
Equality and AI: examining disparities in artificial intelligence
By
–
everyone is equal, some are more equal than others
-
Lawsuit Challenges How Artificial Intelligence Is Built
By
–
Lawsuit Takes Aim at the Way A.I. Is Built: