not your prompt Your prompts in ChatGPT / DALLE3 are actually never used Instead, GPT4 writes its own prompts (with clear instructions to never show them to you) But if you ask for them, you get them ChatGPT/DALLE3 takes your input as a precursor to the actual prompt
LLMS
-
Copilot Chat Falls Short Against GPT-4 Performance
By
–
Spent some time with Copilot Chat today on various projects and it couldn’t keep up with much. Gap between it and GPT-4 is noticeably large.
-
LLMs Design Robot Reward Functions at Human Level
By
–
Eureka: Human-Level Reward Design via Coding Large Language Models Ma et al.: https://
arxiv.org/abs/2310.12931 #Robotics #ArtificialIntelligence #LargeLanguageModels -
Fine-tuning LLMs: Local Communities and Development Resources
By
–
I don't find much great info on *doing* fine-tuning at r/localllama, but I find the info there on *using* fine-tunes really great. The folks that create the tunes that r/localllama do their development in the open on various discords (e.g. alignment labs, nous, skunkworks)
-
Transformer Learning Rates: Encoder Head and Layer Optimization
By
–
For transformers text decoders it's not clear yet afaik – but at least having the encoder head at a higher lr seems to be reliable. I also suspect the first 2 and last 3 layers in the body should have higher lr but I haven't got rigorous tests.
-
GPT-4 Evolves Reward Function Code for Simulated Robot Control
By
–
GPT-4 for evolving the code of a reward function to control a simulated robot:
-
The Boundless Demand for AI-Powered Insights
By
–
The boundless demand for insight | Hex https://
bit.ly/3Poo1Qb #AI #MachineLearning #DeepLearning #LLMs #DataScience -
LLM Could Improve Literacy Levels
By
–
I guess if it’s an LLM at least it’ll improve their literacy level…
-
Weight Decay Ineffectiveness in Llama and Mistral Models
By
–
Note that Llama and Mistral have parameterised norm layers, so weight decay has no regularizing effect
-
Privacy Violations in Large Language Models Through Inference
By
–
Beyond Memorization: Violating Privacy Via Inference with Large Language Models Staab et al.: https://
arxiv.org/abs/2310.07298
v1
… #ArtificialIntelligence #LargeLanguageModels #MachineLearning