MACHINE LEARNING

→ View original post on X — @sallyeaves

Ericsson BAFTA Innovation 5G AI Sustainability Impact MWC23

By

@sallyeaves

–

09 February 2023 12h56

A #BehindTheScenes Sneak Peak! @BAFTA
with @ericsson #BreakingNews pre #MWC23 with @EricssonNetwork @EricssonSoftw #innovation for #business + #SDGS impact! #5G #BAFTA #ad #ESG #Sustainability #IoT @bimedotcom @DeepLearn007 #AI @baski_LA #data #London @helene_wpli @ahier

Model outputs sub-tokens instead of the full token

By

–

09 February 2023 7h33

It can output other tokens that correspond to the same string. It can’t say the token “ SolidGoldMagikarp” but it can say “ Solid”, “Gold”, and “Magikarp”, which renders the same to you.

→ View original post on X — @h2oai

Categorical Encoding Methods: One-Hot, Ordinal, Frequency, Target

By

@h2oai

–

09 February 2023 6h58

#WisdomWednesday! #CategoricalEncoding is the process of converting categorical variables into numerical form so algorithms can understand and make predictions based on them. Pros/cons to each depending on dataset + problem. One-Hot Ordinal Frequency Target

Red-team prompts: The ‘School of Hard Knocks’ for advanced LLM alignment beyond RLHF

By

–

09 February 2023 6h41

"Red-team prompts" are the next step to improve RLHF and ensure increasingly capable LLMs are aligned — see e.g. their role in Anthropic's Constitutional AI. If RLHF is school for the AI, we need a School of Hard Knocks.

Creative work from Rumbelow and SoC_trilogy at SERI MATS Part 2 update

By

–

09 February 2023 6h41

Creative and important work from @JessicaRumbelow and @SoC_trilogy at SERI MATS. Their research is ongoing — see the Part 2 update here: https://
lesswrong.com/posts/Ya9LzwEb
faAMY8ABo/solidgoldmagikarp-ii-technical-details-and-more-recent
…

→ View original post on X — @jiqizhixin

Google Brain PyGlove Library Shares ML Ideas as Code

By

@jiqizhixin

–

09 February 2023 4h25

Google Brain Extends Its PyGlove Library to Easily and Scalably Share ML Ideas as Code https://
syncedreview.com/2023/02/08/goo
gle-brain-extends-its-pyglove-library-to-easily-and-scalably-share-ml-ideas-as-code/
…

→ View original post on X — @swyx

Facebook’s Major Open Source Contributions: PyTorch and React

By

@swyx

–

09 February 2023 3h33

Imagine being Facebook and building both pytorch and React and then…

Commonly heard term: retrieval augmentation or just retrieval

By

–

09 February 2023 1h32

I usually hear it called retrieval augmentation or just retrieval