As I use Phi 3 mini more, it is clear that model is a bit weird. It is usually quite good to start, but tends to loop quite often, repeating things, and also sometimes descend into autoregressive madness.
GENERATIVE AI
-
Microsoft Researcher Details Special Tokens in Fine-Tuning Process
By
–
Note from Microsoft researcher Gustavo de Rosa concerning their special tokens: "These tokens have not been used during fine-tuning, i.e., they will be removed in the future. We used: , , , and "
-
GPT-3 and Copilot Examples for URL Guessing and Testing
By
–
I have a few examples in https://t.co/aymMPeMsdG and https://t.co/n38dNNX8Vw pic.twitter.com/jPEzopNALi
— Simon Willison (@simonw) 23 avril 2024I have a few examples in https://
til.simonwillison.net/gpt3/guessing-
amazon-urls
… and https://
til.simonwillison.net/gpt3/writing-t
est-with-copilot
… -
User adoption challenges switching from Copilot to alternative AI tools
By
–
I tried it once but it didn't stick for me, I think because I've invested so much time in Copilot and don't want to have to spend the time figuring out all of the intuitions needed for something else
-
Anthropic Research: Probes Detect Backdoored Sleeper Agent Models
By
–
New Anthropic research: we find that probing, a simple interpretability technique, can detect when backdoored "sleeper agent" models are about to behave dangerously, after they pretend to be safe in training. Check out our first alignment blog post here: https://
anthropic.com/research/probe
s-catch-sleeper-agents
… -
AI Text Editor Adds Self-Aware Hack Comments Automatically
By
–
I genuinely love it when it adds "this is a hack" comments, my text editor is judging me!
-
Phi 3 Mini 3.8B: Powerful Reasoning in Tiny Model
By
–
For such a tiny model (it can run on your phone!) Phi 3 mini 3.8B seems to do a pretty nice job on real world reasoning and planning tasks.
-
Fine-tuning Primer: Guide to Timing, Budget, Data, and Tools
By
–
Check out this informative primer on all things #finetuning from Daniel Porras Reyes at @flybridge
. Topics: When's the right time to fine-tune Budget / resource considerations Prepping data for fine-tuning Choosing the right tool Check it out: https://
pbase.ai/3JxpMI7 -
Building Intuition for Better Copilot Results
By
–
This is exactly my experience – there's so much depth to getting good results out of Copilot, and like so many things LLM it comes down to building up a weird, almost subconscious intuition about how best to use it
-
Mastering AI coding assistance through practice and proper prompting
By
–
I've also gotten really good at it. I think people who dislike it must have given up too early. You have to learn what to expect, what works, what doesn't work, how to position your cursor (e.g. to not get distracting suggestions), and how to prompt it well via code/comments