Have you seen thoughtful people that you wish to engage with claiming that asking for redteaming of >$100M models is fascism? If not, engage with what those people actually say.
LLMS
-
Text Embeddings Dimensional Encoding Research Investigation
By
–
reading this thread and I feel obligated to shill my own research! I’ve been investigating this question wrt to text embeddings, specifically how many dimensions can perfectly encode text up to what length
-
Cerebras Accelerates 175B LLM Training with PyTorch Single Device
By
–
Cerebras presented at the PyTorch Developer Conference and covered how we accelerate Large Language Model (175B+) training using PyTorch, Torch-MLIR, and the simplicity of single device training without a single torch.distributed instruction Watch here:
-
AI Model Size Regulation and Training Compute Requirements
By
–
Regulation starts at roughly two orders of magnitude larger than a ~70B Transformer trained on 2T tokens — which is ~5e24. Note: increasing the size of the dataset OR the size of the transformer increases training flops. The (rumored) size of GPT-4 is regulated.
-
LLaMa2-70B Training Costs: Computing Efficiency Analysis
By
–
Calculations:
LLaMa2-70B was trained on 2T tokens, and 3.3m hours of A100 GPU time. At a HFU of ~60%, LLama2-70B took ~4.4e+24 flops (3.3m * 624TFlops bfloat16 * 60% HFU). -
Balance AI Models with Philosophical Wisdom for Innovation
By
–
Open your mind to the vast potential of AI models like Gpt-4 and Llama-2. Balance their capabilities with wisdom, as parallel to Plato's philosophical rigor. Use them to innovate in thinking and learning.
-
Practical GPT-4 and Llama-2 Applications Without Coding
By
–
Unlock your AI potential with practical applications of GPT-4 and Llama-2! This week's iteration provides an exploration of what you can actually do with these Large Language Models (LLMs) – and the best part? No coding skills are required. Some insights…
-
AI Assistants and LLMs Boost Productivity and Innovation
By
–
Personalized assistants and chatbots boost productivity and foster innovation across fields. Like creative partners, they offer new ideas and strategies, assisting in writing, coding, or brainstorming. LLMs like GPT-4 and Llama-2 can offer fresh perspectives.
-
Rethinking ‘Stochastic Parrots’: Terminology and AI Ethics Debate
By
–
Yeah — I really dislike the framing of stochastic parrots as an insult against LLMs (as if they were something that could be insulted!) and extra dislike people using the phrase to refer to other people.
-
Enhancing PostgreSQL with AI Using EvaDB Integration
By
–
Augmenting PostgreSQL with AI using EvaDB https://
bit.ly/3Qv9zYg #AI #MachineLearning #DeepLearning #LLMs #DataScience