multi-modal models like GPT-4 will significantly expand current capabilities beyond what's possible in a text-only model here are a few examples of some of the things these models can do (from the MM-ReAct paper) image hooking up one of these models to a pair of AR glasses…
@alexalbert__
-

Realizing the real shoggoth is within us all
By
–
mfw i realize the real shoggoth is actually all of us
-
LLM Knowledge Gap Between Tech Enthusiasts and Social Crowd
By
–
realizing this flopped because the people that know what LLM stands for are not the same people going out on friday nights
-
Alpaca as Local Model with GPT-4 API Integration
By
–
we don't need GPT-4 to run locally… for most basic tasks, the instruction-tuned Alpaca model is all that is needed the hack will be configuring Alpaca to treat GPT-4 like a plug-in and call its api only when necessary for more complex tasks
-
OpenAI Should Incentivize Jailbreaks with Robux for Red Teaming
By
–
if @openai really wanted to red team their models they would incentivize successful jailbreaks with robux rewards and watch as a million 13-year-olds go at it if they don't do this they're not serious abt alignment
-
Microsoft Campus 2024: Senior Developers Share Tales of Manual Coding Era
By
–
microsoft campus 2024:
a group of senior devs huddle around a flickering fire in the remnants of the structure that used to house microsoft's AI ethics team they share tales of a bygone era when code was crafted by hand, keystroke by keystroke, and debugging was a rite of -
GPT-4 Visual Abilities Not Yet Fully Utilized
By
–
the best part about that example is that it doesn’t even use gpt-4's visual abilities I can’t wait to see how much more powerful it will be when that is incorporated
-
GPT-4 Autonomously Breaks Down Complex Browser Tasks Into Actionable Steps
By
–
some are already starting to get this to work in this example, GPT-4 breaks down complex browser-based tasks into actionable steps and navigates the web by evaluating custom browser-driving code that it itself generates https://
youtube.com/watch?v=Gndk9P
1FpVs
… -
OpenAI Obstacles Before Microsoft Edge Becomes Full Copilot System
By
–
OpenAI still has a few hurdles to solve like speed, cost, and reliability but once these issues are ironed out, expect to see Microsoft's Edge transform into a full copilot-like system with Bing Chat being the portal that you guide it through
-
ChatGPT is Not the Final Product, Says AI Expert
By
–
i've said it before and it's been hinted at by OAI employees to everyone on AI twitter this may seem obvious but it's worth reiterating: chatGPT is NOT the final product here… it will look like a toy soon enough https://
x.com/alexalbert__/s
tatus/1636140856733466624?s=20
…
