The model will output the same result, no matter the speed. What faster inference enables is more thinking in the same amount of time.
TECHNOLOGY
-
Running AI Applications on Budget Laptops: RAM Requirements
By
–
Presumably this one but I'm surprised it runs at all on a cheap laptop, @damnkittyworks how much RAM do you have?
-
Character-Level GPT Models Launch ML Training Journey
By
–
Dude…. big fan. Your character-level GPT models were how I initially got into training models
-
LLaMA 3-based model deployment nearing completion
By
–
Very soon. This is one of the last things I have to get working well before we can push a LLaMA 3-based model live.
-
USB Key Hardware Device Generates Strong User Demand Interest
By
–
i'd pay $$ to be shipped this USB key right now, to be honest
-
BLOB Columns: Embeddings Storage in LLM Datasette
By
–
BLOB columns: https://
llm.datasette.io/en/stable/embe
ddings/storage.html
… -
Meta-Llama-3-70B runs on M2 Mac with 64GB RAM
By
–
OK, can confirm that it works on an M2 with 64GB of RAM I had to quit Firefox and VS Code to free up enough RAM for it to run – Meta-Llama-3-70B-Instruct.Q4_0.llamafile now uses 38GB of RAM and runs at about 7.5 tokens a second
-
Exponential Growth Perception During Sigmoid Curve Inflection
By
–
yearly reminder everything looks exponential from the middle of a sigmoid
-
Automation and Digitalization Address Industrial Talent Attraction Challenge
By
–
“The majority of industrial companies say attracting talent is a key challenge. Increased automation and digitalization can overcome it and empower the next generation workforce.” https://
buff.ly/4axWCEM #sponsored #se_iiot #HM24 #HM_IIoT #Digitaltransformation #IIoT @FrRonconi -
Harold Sinnott visits Shahi Qila Fort in Lahore after ICTNAsia
By
–
Visiting the vibrant Shahi Qila Fort in Lahore, Pakistan, after a week at #ICTNAsia, the technology and telecom conference, including the #AIsummit. It’s great to be here in Lahore with amazing fellow delegates from around the world. Special thanks to the wonderful people of… pic.twitter.com/le8QV0dK5I
— Harold Sinnott #MWC26 (@HaroldSinnott) 21 avril 2024Visiting the vibrant Shahi Qila Fort in Lahore, Pakistan, after a week at #ICTNAsia, the technology and telecom conference, including the #AIsummit. It’s great to be here in Lahore with amazing fellow delegates from around the world. Special thanks to the wonderful people of