Announcing #Grok by @xai @elonmusk v/ @_akhaliq Blog https://
x.ai ***************
trained a prototype LLM (Grok-0) with 33 billion parameters. This early model approaches LLaMA 2 (70B) capabilities on standard LM benchmarks but uses only half of its
INNOVATION
-

xAI Announces Grok-0: 33B Parameter LLM Approaching LLaMA 2
By
–
-
ChatGPT Hallucinations in Code Citations: A Critical Warning
By
–
(Careful on using ChatGPT as an oracle for the code, Internets, as it sometimes hallucinates citations, and they’ll look as plausible to you as they do to it.)
-

ARPA-H and PostLive Host Cancer Innovation Event
By
–
This week, join @ARPA_HDirector and me @PostLive for innovations vs. cancer Register: http://
ccnov2023.splashthat.com -

Gen Z Startup Reimagines Comic Shop Experience
By
–
🏈👨🏻💻👩🏻💻 Sunday football while helping my son with his college applications and a startup he’s working on that reimagines the comic book & collectibles shop experience for tech savvy Gen Z and Gen Alpha kids. pic.twitter.com/EDfW6CXXou
— 🖤 Christine (@christinelu) 5 novembre 2023Sunday football while helping my son with his college applications and a startup he’s working on that reimagines the comic book & collectibles shop experience for tech savvy Gen Z and Gen Alpha kids.
-

FP8 Low-Precision Training Improves LLM Efficiency Without Hyperparameter Changes
By
–
10/ FP8-LM – finds that when training FP8 LLMs most variables, such as gradients and optimizer states, in LLM training, can employ low-precision data formats without compromising model accuracy and requiring no changes to hyper-parameter.
-

Symmetry Framework in Machine Learning Models
By
–
7/ Symmetry in Machine Learning – presents a unified and methodological framework to enforce, discover, and promote symmetry in ML; also discusses how these ideas can be applied to ML models such as multilayer perceptions and basis function regression.
-
Next Generation AlphaFold Expands Structure Prediction Capabilities
By
–
8/ Next Generation AlphaFold – a new iteration of AlphaFold that greatly expands its range of applicability and shows capabilities of joint structure prediction of complexes including proteins, nucleic acids, small molecules, ions & modified residue.
-

Open DAC 2023: 38M DFT calculations MOF materials dataset
By
–
6/ Open DAC 2023 – introduces a dataset consisting of more than 38M density functional theory (DFT) calculations on more than 8,800 MOF materials containing adsorbed CO2 and/or H2O; properties for DAC are identified directly in the dataset.
-

Efficient Context Window Extension Method for Large Language Models
By
–
5/ Efficient Context Window Extension of LLMs – proposes a compute-efficient method for efficiently extending the context window of LLMs beyond what it was pretrained on; models of up to 128K context length reproduced.