The analogy between GPTs of today to the CPUs of early days of computing are interesting. GPT is a funny kind of programmable text computer. Have to think through it more but e.g.: ## Memory
GPT-4 RAM is ~log2(50K vocab size)*(32K context length)/(8 bits/byte) ~= 64kB,
AI
-
GPT as Programmable Text Computer: Memory Analysis Analogy
By
–
-
Kortschak Fellowship Supports AI Research at Caltech
By
–
Thank you @WKortschak for supporting @caltech and my work through the Kortschak fellow program!
-
China’s AI Strategy: Key CCP Strategist Wang Huning Analysis
By
–
This book was recommended to me by Dick O'Neill. Written by one of the key strategists in the CCP, Wang Huning. Worth a read and worth reflecting on how America can strengthen our competitiveness against the PRC: https://
amzn.to/3nHIpRV -
LLM Agents Learning from Experience for Long-Term Planning
By
–
Great analysis of the current state of LLM-driven autonomous agents (what works, what doesn't work) IMHO, the next steps are autonomous: learning from experience and then using this synthetic data to fine-tune LLM to be better at following long-term plans, thinking in the loop,
-
Can You Execute Tasks Simultaneously Across 64 GPUs?
By
–
But can you do it with 64 simultaneous GPUs?
-
Physical-Digital-Physical Loop in Industry 4.0 Manufacturing
By
–
At the heart of the Industry 4.0 paradigm is the physical-digital-physical (PDP) loop, defined as the cyclical flow of information and actions from the physical world to the digital world and vice versa. Microblog and social design by @antgrasso #Industry40 #IoT #IIoT
-
Building Dry Academic AI Response Tool Experiment
By
–
Just toying around when I read your tweet and built this, which I instructed to respond in a very dry, third person, caveated, academic way. Give it a try: https://
unrestrictedintelligence.com/ask_the_knowle
dge_font
… -
OpenAI Takes Fun GPT-4 Newsletter Report
By
–
wrote a bit about it in my newsletter this week https://
thepromptreport.com/p/report-7-ope
nai-took-fun-gpt4
… -
Coding with Copilot as therapeutic mental health tool
By
–
Coding calms me down when I’m depressed or anxious, so coding with copilot is like doing a therapy.
-
FinOps Driving Cloud Financial Accountability India’s Digital Economy
By
–
How #FinOps is driving cloud financial accountability in India’s digital economy https://
techobserver.in/2023/04/07/how
-finops-is-driving-cloud-financial-accountability-in-indias-digital-economy/
… via @TechObservor